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(54) INFORMATION PROCESSING APPARATUS AND METHOD, PROGRAM, AND RECORDED 
MEDIUM 



(57) In case continuous reproduction is commanded 
from a first AV stream to a second AV stream, a third AV 
stream, made up of a preset portion of the first AV 
stream and a preset portion of the second AV stream, 
is generated. The third AV stream Is reproduced when 
reproduction is switched from the first AV stream to the 
second AV stream. As the infomnation pertinent to the 



third AV stream, the address Information of a source 
packet of the first AV stream at a timing of switching from 
the first AV stream to the third AV stream and the ad- 
dress information of a source packet of the second AV 
stream at a timing of switching from the third AV stream 
to the second AV stream, are generated. This enables 
reproduction such as to maintain continuity between 
separately recorded AV streams. 
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Description 

Technical Field 

5 [0001] This invention relates to an infonnation processing method and apparatus, a program, and a recording medium 
and, more particularly, to an information processing method and apparatus, a program and a recording medium, con- 
figured for maintaining continuity of moving pictures in a reproducing domain. 

Bacl<ground Art 

10 

[0002] Recently, a variety of types of optical discs have been proposed as a recording medium that can be removed 
from a recording apparatus. These recordable optical discs have been proposed as a large capacity medium of several 
GBs and are thought to be promising as a medium for recording AV (audio visual) signals, such as video signals. 
Among the digital AV signal sources (supply sources), to be recorded on this recordable optical disc, there are CS 
^5 digital satellite broadcast and BS digital broadcast. Additionally, the ground wave television broadcast of the digital 
system has also been proposed for future use. 

[0003] The digital video signals, supplied from these sources, are routinely compressed under the MPEG (Moving 
Picture Experts Group) 2 system. In a recording apparatus, a recording rate proper to the apparatus is set. If digital 
video signals of the digital broadcast are recorded in the conventional image storage mediums for domestic use, digital 
20 video signals are first decoded and subsequently bandwidth-limited for recording. In the case of the digital recording 
system, including, of course, the MPEG1 Video, MPEG2 video and The present invention provides an DV systems, 
digital video signals are first decoded and subsequently re-encoded in accordance with an encoding system for the 
recording rate proper to the apparatus for recording subsequently. 

[0004] However, this recording system, in which the supplied bitstream is decoded once and subsequently band- 
25 width-limited and re-encoded prior to recording, suffers from deteriorated picture quality. If, In recording compressed 
video digital signals, the transmission rate of input digital signals is less than the recording rate for the recording and/ 
or reproducing apparatus, the method of directly recording the supplied bitstream without decoding or re-encoding 
suffers from deterioration in the picture quality only to the least extent. However, if the transmission rate of the input 
digital signals exceeds the recording rate of the recording and/or reproducing apparatus, it is indeed necessary to re- 
30 encode the bitstream and to record the so-re-encoded bitstream, so that, after decoding in the recording and/or repro- 
ducing apparatus, the transmission rate will be not higher than the upper limit of the disc recording rate. 
[0005] If the bitstream is transmitted in a variable rate system in which the bit rate of the input digital signal is increased 
or decreased with time, the capacity of the recording medium can be exploited less wastefully in the case of a disc 
recording apparatus adapted for transiently storing data in a buffer and for recording the data in a burst fashion than 
35 In the case of a tape recording system having a fixed recording rate imposed by the fixed rpm of the rotary head. 

[0006] Thus, it may be predicted that, in the near future when the digital broadcast Is to become the mainstream, an 
increasing demand will be raised for a recording and/or reproducing apparatus In which broadcast signals are recorded 
as digital signals, without decoding or re-encoding, as in a data streamer, and in which a disc is used as a recording 
medium. 

40 [0007] In reproducing data recorded on a recording medium in the above-described recording apparatus, there is 
known so-called skip reproduction in which reproduction is continued up to a preset picture and a picture temporally 
spaced apart from the preset picture is reproduced next. This skip reproduction has a drawback that temporal continuity 
is lost in the reproduced pictures. 

45 Disclosure of the Invention 

[0008] It is therefore an object of the present invention to enable reproduction such as to maintain continuity of moving 
pictures in the playback domain. 

[0009] The present invention provides an infonnation processing apparatus including generating means for gener- 
50 ating, in case continuous reproduction from a first AV stream to a second AV stream is commanded, a third AV stream 

made up of a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV stream 
being reproduced when reproduction is switched from the first AV stream to the second AV stream, and the address 
information, as the information pertinent to the third AV stream, the address information being made up of the information 
on an address of a source packet of the first AV stream at a timing of switching of reproduction from the first AV stream 
55 to the third AV stream, and of the information on the address of a source packet of the second AV stream at a timing 
of switching of reproduction from the third AV stream to the second AV stream, and recording means for recording the 
third AV stream and the address information, as generated by the generating means. 

[0010] Preferably, an arrival time stamp of the source packet of the first AV stream included in the address information 
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generated by the generating means, and an arrival time stamp of a source packet located at a leading end of the third 
AV stream, are continuous to each other, and an arrival time stamp of the source packet of the second AV stream 
included in the address information generated by the generating means and an arrival time stamp of a source packet 
located at a trailing end of the third AV stream are continuous to each other. 
5 [0011] Preferably, a sole discontinuous point exists in the arrival time stamp of the source packet in the third AV 
stream. 

[0012] Preferably, the address is determined so that a data portion of the AV stream previous to a source packet 
specified by the Information on the address of the source packet of the first AV stream contained in the address infor- 
mation generated by the generating means will be located in a continuous area of not less than a preset size on a 
10 recording medium. 

[0013] Preferably, the address is detemiined so that a data portion of the AV stream subsequent to a source packet 
specified by the information on the address of the source packet of the second AV stream contained In the address 
information generated by the generating means will be located in a continuous area of not less than a preset size on 
a recording medium. 

15 [0014] Preferably, the third AV stream is generated so that the third AV stream will be located in a continuous area 
of not less than a preset size on the recording medium. 

[0015] The present invention also provides an information generating method Including a step of generating, in case 
continuous reproduction from a first AV stream to a second AV stream is commanded, a third AV stream made up of 
a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV stream being repro- 

20 duced when reproduction is switched from the first AV stream to the second AV stream, and a step of generating the 
address information, as the information pertinent to the third AV stream, the address infonnation being made up of the 
infomnation on an address of a source packet of the first AV stream at a timing of switching of reproduction from the 
first AV stream to the third AV stream, and of the information on the address of a source packet of the second AV 
stream at a timing of switching of reproduction from the third AV stream to the second AV stream. 

25 [0016] The present invention also provides a recording medium having recorded thereon a computer-readable pro- 
gram, in which the program Includes a step of generating, In case continuous reproduction from a first AV stream to a 
second AV stream is commanded, a third AV stream made up of a preset portion of the first AV stream and a preset 
portion of the second AV stream, the third AV stream being reproduced when reproduction is switched from the first 
AV stream to the second. AV stream, and a step of generating the address information, as the infonnation pertinent to 

30 the third AV stream, the address information being made up of the information on an address of a source packet of 
the first AV stream at a timing of switching of reproduction from the first AV stream to the third AV stream, and of the 
Infomnation on the address of a source packet of the second AV stream at a timing of switching of reproduction from 
the third AV stream to the second AV stream. 

[001 7] The present invention also provides a program for having a computer execute a program, in which the program 
35 Includes a step of generating, in case continuous reproduction from a first AV stream to a second AV stream Is com- 
manded, a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream, the third AV stream being reproduced when reproduction Is switched from the first AV stream to the second 
AV stream, and a step of generating the address information, as the information pertinent to the third AV stream, the 
address information being made up of the information on an address of a source packet of the first AV stream at a 
40 timing of switching of reproduction from the first AV stream to the third AV stream, and of the information on the address 
of a source packet of the second AV -stream at a timing of switching of reproduction from the third AV stream to the 
second AV stream. 

[0018] The present invention also provides an Information processing apparatus including first readout means for 
reading out a first AV stream, a second AV stream or a third AV stream from a recording medium, second readout 

45 means for reading out, as the information pertinent to the third AV stream, the Information on an address of a source 
packet of the first AV stream at a timing of switching of reproduction from the first AV stream to the third AV stream, 
and of the information on the address of a source packet of the second AV stream at a timing of switching of reproduction 
from the third AV stream to the second AV stream , and reproducing means for performing reproduction as reproduction 
Is switched from the first AV stream read out by the first readout means to the third AV stream and from the third AV 

50 stream to the second AV stream, based on the information pertinent to the third AV stream read out by the second 
readout means. 

[0019] The present Invention also provides an information processing method including a first readout controlling 
step of reading out a first AV stream, a second AV stream or a third AV stream from a recording medium, a second 
readout controlling step of reading out, as the infonnation pertinent to the third AV stream, the information on an address 
55 of a source packet of the first AV stream at a timing of switching of reproduction from the first AV stream to the third 
AV stream, and of the information on the address of a source packet of the second AV stream at a timing of switching 
of reproduction from the third AV stream to the second AV stream, and a reproducing step of perfonning reproduction 
as reproduction is switched from the first AV stream read out by the first readout means to the third AV stream and 
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from the third AV stream to the second AV stream, based on the infomiation pertinent to the third AV stream read out 
by the second readout means. 

[0020]_ The present invention also provides a recording medium having recorded thereon a computer-readable pro- 
gram, In which the program includes a first readout controlling step of reading out a first AV stream, a second AV stream 

5 or a third AV -stream from a recording medium, a second readout controlling step of reading out, as the information 
pertinent to the third AV stream, the infomriation on an address of a source packet of the first AV stream at a timing of 
switching of reproduction from the first AV stream to the third AV stream, and of the infomriation on the address of a 
source packet of the second AV stream at a timing of switching of reproduction from the third AV stream to the second 
AV stream, and a reproducing step of perfomning reproduction as reproduction is switched from the first AV stream 

10 read out by the first readout means to the third AV stream and from the third AV stream to the second AV stream, based 
on the infonnation pertinent to the third AV stream read out by the second readout means. 

[0021] The present Invention also provides a program for having a computer execute a program, in which the program 
includes a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium, a second readout controlling step of reading out, as the information pertinent to the third AV 

15 stream, the infonnation on an address of a source packet of the first AV stream at a timing of switching of reproduction 
from the first AV stream to the third AV stream, and of the infonnation on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, and a reproducing 
step of performing reproduction as reproduction is switched from the first AV stream read out by the first readout means 
to the third AV stream and from the third AV stream to the second AV stream, based on the information pertinent to 

20 the third AV stream read out by the second readout means. 

[0022] The present invention also provides a recording medium having recorded thereon the address information 
including, In case continuous reproduction from a first AV stream to a second AV stream is commanded, a third AV 
stream made up of a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV 
stream being reproduced when reproduction is switched from the first AV stream to the second AV stream, and the 

25 address infonnation, as the information pertinent to the third AV stream, the address infomriation being made up of the 
infonnation on an address of a source packet of the first AV stream at a timing of switching of reproduction from the 
first AV stream to the third AV stream, and of the Infonnation on the address of a source packet of the second AV 
stream at a timing of switching of reproduction from the third AV stream to the second AV stream. 
[0023] In the Information processing method and apparatus, and the program, according to the present invention, if 

30 the it is commanded to perform reproduction continuously from the first AV stream to the second AV stream, there Is 
generated a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream and which is reproduced when reproduction is switched from the first AV stream to the second AV stream, while 
there Is generated, as the information pertinent to the third AV stream, the address infomnation made up of the infor- 
mation on an address of a source packet of the first AV stream at a timing of switching of reproduction from the first 

35 AV stream to the third AV stream, and of the infonnation on the address of a source packet of the second AV stream 
at a timing of switching of reproduction from the third AV stream to the second AV stream. 

[0024] In the infonnation processing method and apparatus, and the program, according to the present invention, a 
first AV stream, a second AV stream or a third AV stream is read out from a recording medium, the address information 
made up of the Information on an address of a source packet of the first AV stream at a timing of switching of reproduction 

40 from the first AV stream to the third AV stream, and the infonnation on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, is read out from 
the recording medium as the Information pertinent to the third AV stream, and reproduction is switched from the first 
AV stream to the third AV stream and from the third AV stream to the second AV stream, as reproduction proceeds, 
based on the read-out information pertinent to the third AV stream. 

45 [0025] Other objects, features and advantages of the present invention will become more apparent from reading the 
embodiments of the present invention as shown In the drawings. 

Brief Description of the Drawings 

50 [0026] 

Fig. 1 shows a configuration of an embodiment of a recording and/or reproducing apparatus according to the present 
invention. 

Flg.2 illustrates the data format of data recorded on a recording medium by a recording and/or reproducing appa- 
55 ratus 1 . 

Fig.3 illustrates Real PlayList and Virtual Play List. 

Flgs.4A, 4B and 4C illustrate the creation of the Real PlayList. 

FIgs.SA, SB and 5C Illustrate deletion of the Real PlayList. 
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Figs.6A and 6B illustrate assemble editing. 

Fig. 7 Illustrates provision of a sub path in the- Virtual PlayList. 

Fig.8 illustrates the changing of the playbacl< sequence of the PlayList. 

Fig.9 illustrates a mark on the PlayList and a mark on the Clip. 

Fig.1 0 illustrates a menu thumbnail. 

Fig.1 1 illustrates mark added to the PlayList. 

Fig.1 2 illustrates a mark added to the Clip. 

Flg.13 illustrates the relation between the PlayList, Clip and the thumbnail file. 

Fig.1 4 illustrates a directory structure. 

Flg.1 5 illustrates a syntax of infr.dvr. 

Fig.1 6 shows a syntax of DVRVolume. 

Flg.1 7 shows a syntax of ResumeVolume. 

Fig.18 shows a syntax of UlApplnfoVolume. 

Fig.1 9 shows a table of character set values. 

Fig.20 shows a syntax of TableOf PlayList. 

Fig. 21 shows another syntax of TableOf PI ay List. 

Flg.22 shows a syntax of the Makers PrivateData. 

Fig.23 shows a syntax of xxxx.rpls and yyyy.vpls. 

Flgs.24A to 24C illustrate the PlayList. 

Fig. 25 shows a syntax of PlayList. 

Fig.26 shows a table of PlayList_type. 

Fig.27 shows a syntax of UlApplnfoPlayList. 

Figs.28Ato 28C illustrate flags-in the UlApplnfoPlayList syntax shown in Fig.27. 

Fig.29 illustrates a Playltem. 

Fig.30 illustrates a Playltem. 

Fig.31 illustrates a Playltem. 

Flg.32 shows a syntax of the Playltem. 

Fig. 33 illustrates IN-time. 

Fig.34 illustrates OUT-time. 

Fig.35 shows a table of Connectlon_Conditlon. 

Figs.36A to 36D illustrate Connection_Conditlon. 

Fig.37 illustrates BridgeSequencelnfo. 

Fig. 38 shows a syntax of BridgeSequencelnfo. 

Fig.39 illustrates SubPlayltem. 

Fig.40 shows a syntax of SubPlayltem. 

Fig. 41 shows a table of Mark_type. 

Fig.42 shows a syntax of PlayLlstMark. 

Fig. 43 shows a table of Mark_type. 

Fig.44 illustrates Mark_time_stamp. 

Fig.45 shows a syntax of zzzzz.clip. 

Flg.46 shows a syntax of Cllplnfo. 

Fig.47 shows a table of Clip_stream_type. 

Fig.48 illustrates offset^SPN. 

Fig.49 illustrates offset_SPN. 

Figs.SOA, SOB illustrate the STC domain. 

Flg.51 illustrates STCJnfo. 

Fig.52 shows a syntax of STC^Info. 

Fig.53 illustrates Programlnfo. 

Fig.54 shows a syntax of Programlnfo. 

Fig.55 shows a syntax of VideoCondinglnfo. 

Fig.56 shows a table of Video_format. 

Flg.57 shows a table of frame_rate. 

Fig.58 shows a table of display_aspect_ratio. 

Fig.59 shows a syntax of AudioCondinglnfo. 

Fig. 60 shows a table of audio_codlng. 

Fig.61 shows a table of audio__component_type. 

Fig. 62 shows a table of sampling_frequency. 

Fig.63 illustrates CPI. 
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Fig.64 illustrates CPI. 

Flg.65 shows a syntax of CPI. 

Fig.66 shows a table of CPI_type. 

Fig.67 illustrates video EP_map. 
5 Flg.68 illustrates EP_map. 

Fig.69 illustrates EP_map. 

Fig.70 shows a syntax of EP_map. 

Flg.71 shows a table of EP_typevalues. 

Fig.72 shows a syntax of EP_map_for_one_stream_PID. 
10 Fig.73 illustrates TU_map. 

Fig.74 shows a syntax of TU_map. 

Fjg.75 shows a syntax of ClipMark. 

Fig.76 shows a table of Mark_type. 

Fig.77 shows a table of Mark_type_stamp. 
15 Fig. 78 shows a syntax of menu.thmb and mark.thmb. 

Fig. 79 shows the syntax of thumbnail. 

Fig.BO shows a table of thumbnail _picture_fomriat. 

Flgs.81 A and 81 Blllustrate tn_block. 

Flg.82 illustrates a structure of a transport stream of DVR MPEG2. 
20 Fig. 83 shows a recorder model of a transport stream of DVR MPEG2. 

Fig. 84 shows a player model of a transport stream of DVR MPEG2. 

Fig.85 shows the syntax of a source packet. 

Fig.86 shows the syntax of TP_extra_header. 

Fig.87 shows a table of a copy pemnission Indicator. 
25 Fig. 88 illustrates seamless connection. 

Fig.89 illustrates seamless connection. 

Flg.90 illustrates seamless connection. 

Flg.91 illustrates seamless connection. 

Fig.92 illustrates seamless connection. 
30 Fig. 93 illustrates audio overlap. 

Fig.94 illustrates seamless connection employing BridgeSequence, 

Fig.95 illustrates seamless connection not employing BridgeSequence. 

Fig.96 shows a DVR STD model. 

Fig.97 is a timing chart for decoding and display. 
35 Fig. 98 shows another syntax of BridgeSequencelnfo. 

Fig.99 illustrates Bridge_Clip when two Playltems are seamlessly connected. 

Fig.1 00 shows a syntax of a Clip Information file. 

Fig.i 01 shows a syntax of a Cllplnfo of the Clip Information file of Fjg.1 00. 

Fig.1 02 shows a syntax of a Sequencelnfo of the Clip Infomnatlon file of Fig.1 00. 
40 Figs.1 03A and 1 038 illustrate database change In case stream data of the Clip AV stream file is partially erased. 

Fig.1 04 is a flowchart for illustrating the preparation of a RealPlayLlst. 

Fig.1 05 is a flowchart for illustrating the formulation of a Virtual PtayList. 

Fig.1 06 Is a flowchart for illustrating the formulation of a bridge sequence. 

Fig.1 07 is a flowchart for illustrating the reproduction of PlayList. 
-^5 Fig.1 08 illustrates a medium. 

Best Mode for Carrying out the Invention 

[0027] Referring to the drawings, present embodiment of the present invention will be explained in detail. Fig.1 shows 
so a typical inner structure of a recording and/or reproducing apparatus 1 embodying the present invention. First, the 
structure of a recording unit 2, configured for recording signals input from outside, is explained. The recording and/or 
reproducing apparatus 1 Is configured for being fed with and recording analog or digital data. 

[0028] Analog video signals and analog audio signals are fed to terminals 11, 12, respectively. The video signals, 
input to the terminal 11, are output to an analysis unit 14 and to an AV encoder 15. The audio signals, input to the 
55 terminal 12, are output to the analysis unit 14 and to the AV encoder 15. The analysis unit 14 extracts feature points, 
such as scene changes, from the input video and audio signals. 

[0029] The AV encoder 15 encodes input video and audio signal to output the system information (S), such as an 
encoded video stream (V), an encoded audio stream (A) and AV synchronization, to a multiplexer 16. 
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[0030] The encoded video stream Is a video stream encoded e.g., with the MPEG (Moving Picture Expert Group) 2 
system, whilst the encoded audio stream is an audio stream encoded in accordance with the MPEG1 system, with the 
encoded audio stream being e.g., an audio stream encoded in e.g., the MPEG1 system or an audio stream encoded 
in accordance with the Dolby AC3 (trademak) system. The multiplexer 1 6 multiplexes the input video and audio streams, 
5 based on the input system information, to output a multiplexed stream through a switch 17 to a multiplexed stream 
analysis unit 18 and to a source packetizer 19. 

[0031] The multiplexed stream is e.g., an MPEG-2 transport stream or an MPEG2 program stream. The source 
packetizer 19 encodes the input multiplexed stream into an AV stream composed of source packets in accordance 
with an application fomiat of a recording medium 100 on which to record the stream. The AV stream is processed in 
10 ECC (error correction and coding) unit 20 and a modulation unit 21 with appendage of ECO codes and with modulation, 
before being output to a write unit 22, which then writes (records) an AV stream file based on a control signals output 
by the controller 23. 

[0032] The transport stream, such as digital television broadcast, input from a digital interface or a digital television 
tuner, is input to a terminal 1 3. There are two recording systems for recording the transport stream Input to the terminal 
15 13, one being a transparent recording system and the other being a system in which recording is preceded by re- 
encoding aimed to lower e.g., the recording bit rate. The recording system command information Is input from a terminal 
24 as a user interface to a controller 23. 

[0033] In the transparent recording of the Input transport stream, a transport stream, input to a terminal 13, is output 
through a switch 1 7 to a multiplexed stream analysis unit 1 8 and to the source packetizer 19. The ensuing processing 
20 of recording an AV stream on a recording medium is the same as that of encoding and recording analog input audio 
and video signals, as described above, and hence Is not explained here for simplicity. 

[0034] If the input transport stream is re-encoded and subsequently recorded, the transport stream, input to the 
terminal 13, is fed to a demultiplexer 26, which demultiplexes the Input transport stream to extract a video stream (V), 
an audio stream (A) and the system information (S). 

25 [0035] Of the stream (information), as extracted by the demultiplexer 26, the video stream is output to an audio 
decoder 27, whilst the audio stream and the system Information are output to the multiplexer 16. The audio decoder 
27 decodes the input transport stream to output the encoded video stream (V) to the multiplexer 16. 
[0036] The audio stream and the system information, output from the demultiplexer 26 and input to the multiplexer 
16, and the video stream, output by the AV encoder 15, are multiplexed, based on the input system information, and 

30 output to the multiplexed stream analysis unit 1 8 and to the source packetizer 1 9 through switch 1 7, as a multiplexed 
stream. The ensuing processing of recording an AV stream on a recording medium is the same as that of encoding 
and recording analog input audio and video signals, as described above, and hence is not explained here for simplicity. 
[0037] The recording and/or reproducing apparatus 1 of the present embodiment records a file of the AV stream on 
the recording medium 100, while also recording the application database infomnation which accounts for the file. The 

35 input infomiation to the controller 23 is the feature information for the moving picture from the analysis unit 14, the 
feature information of the AV stream from the multiplexed stream analysis unit 18 and the user command information 
input at a terminal 24. 

[0038] The feature information of the moving picture, supplied from the analysis unit 1 4, is generated by the analysis 
unit 14 when the AV encoder 15 encodes video signals. The analysis unit 14 analyzes the contents of the input video 
40 and audio signals to generate the information pertinent to the pictures characteristic of the input moving picture signals 
(clip mark). This information is the information indicating a picture of characteristic clip mark points, such as program 
start points, scene change points, CM commercial start and end points, title or telop in input video signals, and also 
includes a thumbnail of the picture and the infomriation pertinentto stereo/monaural switching points and muted portions 
of audio signals. 

45 [0039] The above picture indicating information is fed through controller 23 to the multiplexer 16. When multiplexing 
a encoded picture specified as clip mark by the controller 23, the multiplexer 16 retums the information for specifying 
the encoded picture on the AV stream to the controller 23. Specifically, this information is the PTS (presentation time 
stamp) of a picture or the address information on the AV stream of an encoded version of the picture. The controller 
23 stores the sort of feature pictures and the information for specifying the encoded picture on the AV stream in asso- 
50 elation with each other. 

[0040] The feature information of the AV stream from the multiplexed stream analysis unit 18 is the information 
pertinent to the encoding information of the AV stream to be recorded, and is recorded by an analysis unit 18. For 
example, the feature information includes the time stamp and address infomnation of the l-plcture in the AV stream, 
discontinuous point information of system time clocks, encoding parameters of the AV stream and change point infor- 
ms mation of the encoding parameters in the AV stream. When transparently recording the transport stream, input from 
the terminal 13, the multiplexed stream analysis unit 18 detects the picture of the aforementioned clip mark, from the 
input transport stream, and generates the information for specifying a picture designated by the clip mark and its type. 
[0041] The user designation infonnation from the terminal 24 is the infomriation specifying the playback domain. 



7 



EP1 198 133 A1 

designated by the user, character letters for explaining the contents of the playback domain, or the information such 
as bookmarks or resuming points set by the user for his or her favorite scene. 

[0042]. Based on the aforementioned input information, the controller 23 creates a database of the AV stream (Clip), 
a database of a group (PlayList) of playback domains (Playltem) of the AV stream, management infomiation of the 
5 recorded contents of the recording medium 100 (info.dvr) and the information on thumbnail pictures. Similarly to the 
AV stream, the application database information, constructed from the above information, is processed in the ECC unit 
20 and the modulation unit 21 and input to the write unit 22, which then records a database file on the recording medium 
100. 

[0043] The above-described application database information will be explained subsequently in detail. 

10 [0044] When the AV stream file recorded on the recording medium 100 (files of picture data and speech data) and 
the application database infomnation, thus recorded on the recording medium 100, are reproduced by a reproducing 
unit 3, the controller 23 first commands a readout unit 28 to read out the application database information from the 
recording medium 100. The readout unit 28 reads out the application database information from the recording medium 
1 00, which then reads out the application database Information from the recording medium 1 00 to send the application 

15 database information through demodulation and error correction processing by a demodulating unit 29 and an ECC 
decoder 30 to the controller 23. 

[0045] Based on the application database information, the controller 23 outputs a list of PlayList recorded on the 
recording medium 100 to a user interface of the terminal 24. The user selects the PlayList, desired to be reproduced, 
from the list of PlayLists. The information pertinent to PlayList, specified to be reproduced, is input to the controller 23. 
20 The controller 23 commands the readout unit 28 to read out the AV stream file necessary in reproducing the PlayList. 
In accordance with the command, the readout unit 28 reads out the corresponding AV stream from the recording 
medium 100 to output the read-out AV stream to the demodulating unit 29. The AV stream, thus input to the demodu- 
lating unit 29, is demodulated by preset processing and output through the processing by the ECC decoder 30 to a 
source depacketizer 31 . 

25 [0046] The source depacketizer 31 converts the AV stream of the application format, read out from the recording 
medium 100 and processed In a preset fashion, into a stream processable by the demultiplexer 26. The demultiplexer 
26 outputs the system information (S), such as the video stream (V), audio stream (A) or the AV synchronization, 
fonning the playback domain (Playltem) of the AV stream specified by the controller 23, to the audio decoder 27, which 
AV decoder 27 decodes the video stream and the audio stream to output the playback video signal and the playback 

30 audio signal to associated terminals 32, 33, respectively. 

[0047] If fed from the terminal 24, as a user interface, with the information instructing random access playback or 
special playback, the controller 23 detenmines the readout position of the AV stream from the recording medium 1 00, 
based on the contents of the database (Clip) of the AV stream, to command the readout unit 28 to read out the AV 
stream. If the PlayList as selected by the user is to be reproduced as from a preset time point, the controller 23 com- 

35 mands the readout unit 28 to read out data from an l-picture having a time stamp closest to the specified time point. 
[0048] When the user has selected a certain clip mark from indexing points or scene change points for the program 
stored in the ClipMark in the Clip Information, as when the user selects a certain picture from a list of thumbnail pictures, 
as demonstrated on a user interface, of the indexing points or scene change points stored in the ClipMark, the controller 
23 determines the AV stream readout position from the recording medium 1 00 to command the readout unit 28 to read 

40 out the AV stream. That is, the controller 23 commands the readout unit 28 to read out data from an l-picture having 
an address closest to the address on the AV stream which has stored the picture selected by the user. The readout 
unit 28 reads out data from the specified address . The read-out data is processed by the demodulating unit 29, ECC 
decoder 30 and by the source packetizer 19 so as to be supplied to the demultiplexer 26 and decoded by the audio 
decoder 27 to reproduce AV data indicated by an address of the mark point picture. 

45 [0049] If the user has commanded fast forward playback, the controller 23 commands the readout unit 28 to sequen- 
tially read out l-picture data in the AV stream in succession based on the database (Clip) of the AV stream. 
[0050] The readout unit 28 reads out data of the AV stream from a specified random access point. The so read-out 
data Is reproduced through processing by various components on the downstream side. 

[0051] The case In which the user edits the AV stream recorded on the recording medium 1 00 is now explained. If 
50 desired to specify a playback domain for the AV stream recorded on the recording medium 1 00, for example, if desired 
to create a playback route of reproducing a portion sung by a singer A from a song program A, and subsequently 
reproducing a portion sung by the same singer A from another song program B,the information pertinent to a beginning 
point (IN-poInt) and an end point (OUT-point) of the playback domain is input to the controller 23 from the terminal as 
a user interface. The controller 23 creates a database of the group (PlayList) of playback domains (Playltem) of the 
55 AV streams. 

[0052] When the user desires to erase a portion of the AV stream recorded on the recording medium 1 00, the infor- 
mation pertinent to the IN-point and the OUT-point of the erasure domain is input to the controller 23, which then 
modifies the database of the PlayList so as to refer to only the needed AV streams. The controller 23 also commands 
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the write unit 22'to erase an unneeded stream portion of the AV stream. 

[0053] The case in which the user desires to specify playback domains of an AV stream recorded on the recording 
medium to create a new playback route, and to interconnect the respective playback domains in a seamless fashion, 
is now explained. In such case, the controller 23 creates a database of a group (PlayLlst) of the playback domains 
5 (Playltem) of the AV stream and undertakes to partially re-encode and re-multiplex the video stream in the vicinity of 
juriction points of the playback domains. 

[0054]> The picture inforrnation at the IN-point and that at the OUT-poInt of a playback domain are Input from a terminal 
24 to a controller 23. The controller 23 commands the readout unit 28 to read out data needed to reproduce the pictures 
at the IN-point and at the OUT-point. The readout unit 28 reads out data from the recording medium 1 00. The data so 
10 read out is output through the demodulating unit 29, ECC decoder 30 and the source packetizer 1 9 to the demultiplexer 
26. 

[0055] The controller 23 analyzes data Input to the demultiplexer 26 to detemriine the re-encoding method for the 
video stream (change of picture_coding_type and assignment of the quantity of encoding bits for re-encoding) and the 
re-multlplexing system to send the system to the AV encoder 15 and to the multiplexer 16. 

15 [0056] The demultiplexer 26 then separates the input stream into the video stream (V), audio stream (A) and the 
system information (S). The video stream may be classed into data input to the audio decoder 27 and data input to 
the multiplexer 16. The former is data needed for re-encoding, and is decoded by the audio decoder 27, with the 
decoded picture being then re-encoded by the AV encoder 15 and thereby caused to become a video stream. The 
latter data Is data copied from an original stream without re-encoding. The audio stream and the system information 

20 are directly input to the multiplexer 1 6. 

[0057] The multiplexer 1 6 multiplexes an input stream, based on the information input from the controller 23, to output 
a multiplexed stream, which is processed by the ECC unit 20 and the modulation unit 21 so as to be sent to the write 
unit 22. The write unit 22 records an AV stream on the recording medium 100 based on the control signals supplied 
from the controller 23. 

25 [0058] The application database information and the operation based on this information, such as playback and 
editing, are hereinafter explained. Fig.2 shows the structure of an application format having two layers, that is PlayList 
and Clip, for AV stream management. The Volume Infonnatlon manages all Clips and PlayLists in the disc. Here, one 
AV stream and the ancillary information thereof, paired together, is deemed to be an object, and is termed Clip. The 
AV stream file is termed a Clip AV stream file, with the ancillary Information being termed the Clip Information file. 

30 [0059] One Clip AV stream file stores data corresponding to an MPEG-2 transport stream arranged in a structure 
prescribed by the application format. By and large, a file is treated as a byte string. The contents of the Clip AV stream 
file are expanded on the time axis, with entry points in the Clip (l-picture) being mainly specified on the time basis. 
When a time stamp of an access point to a preset Clip is given, the Clip Information file Is useful In finding the address 
information at which to start data readout in the Clip AV stream file. 

35 [0060] Referring to Fig .3, PlayList is now explained, which is provided for a user to select a playback domain desired 
to be viewed from the Clip and to edit the playback domain readily. One PlayList is a set of playback domains in the 
Clip. One playback domain In a preset Clip is termed Playltem and is represented by a pair of an IN-point and an OUT- 
polnt on the time axis. So, the PlayList is fomned by a set of plural Playltems. 

[0061] The PlayList is classified into two types, one of which is Real PlayList and the other of which Is Virtual PlayList. 
40 The Real PlayList co-owns stream portions of the Clip it Is referencing. That is, the Real PlayList takes up in the disc 
the data capacity corresponding to a stream portion of the Clip it is referencing and, when Real PlayList is erased, the 
data of the stream portion of the Clip It Is referencing is also erased. 

[0062] The Virtual PlayList Is not co-owning Clip data. Therefore, if the Virtual PlayList Is changed or erased, the 

contents of the Clip are In no way changed. 
45 [0063] The editing of.the Real Playlist is explained. Fig.4A shows creation of Real PlayList and, if the AV stream is 

recorded as a new Clip, the Real PlayList which references the entire Clip is a newly created operation. 

[0064] Fig.4B shows the division of the real PlayList, that Is the operation of dividing the Real PlayList at a desired 

point to split the Real PlayList in two Real PlayLists. This division operation is performed when two programs are 

managed in one clip managed by a sole PlayList and when the user intends to re-register or re-record the programs 
50 as separate individual programs. This operation does not lead to alteration of the Clip contents, that is to division of 

the Clip itself. 

[0065] Fig.4C shows the combining operation of the Real PlayList which is the operation of combining two Real 
PlayLists into one new Real PlayList. This combining operation is performed such as when the user desires to re- 
register two programs as a sole program. This operation does not lead to alteration of the Clip contents, that is to 
55 combining the clip itself into one. 

[0066] Fig.5A shows deletion of the entire Real PlayList. If the operation of erasing the entire preset Real PlayList, 

the associated stream portion of the Clip referenced by the deleted Real PlayList is also deleted. 

[0067] Flg.5B shows partial deletion of the Real PlayList. If a desired portion of the Real PlayList is deleted, the 
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associated Play Item is altered to reference only the needed Clip stream portion. The corresponding stream portion of 
the Clip is deleted. 

[0068] Fig.SC shows the minimizing of the Real PlayList. It is an operation of causing the Playitem associated with 
the Real PlayList to reference only the stream portion of the Clip needed for Virtual PlayList. The corresponding stream 
5 portion of the Clip not needed for the Virtual PlayList is deleted. 

[0069] If the Real PlayList is changed by the above-described operation such that the stream portion of the Clip 
referenced by the Real PlayList is deleted, there is a possibility that the Virtual PlayList employing the deleted Clip is 
present such that problems may be produced in the Virtual PlayList due to the deleted Clip. 

[0070] In order to prevent this from occurring, such a message which runs: "If there exists the Virtual Play List ref- 
10 erencing the stream portion of the Clip the Real PlayList Is referencing, and the Real PlayList is deleted, the Virtual 

PlayList itself is deleted - is it all right?" is displayed for the user in response to the user's operation of deletion by way 

of confirmation or alarming, after which the processing for deletion is executed orcancelled subject to user's commands. 

Alternatively, the minimizing operation for the Real PlayList is perfomied in place of deleting the Virtual PlayList. 

[0071] The operation for the Virtual PlayList is now explained. If an operation is performed for the Virtual PlayList, 
'5 the contents of the Clip are not changed. Figs.6A and 6B show the assembling and editing (IN-CUT editing). It is an 

operation of creating Playitem of the playback domain the user has desired to view to create Virtual PlayList. The 

seamless connection between Playltems is supported by the application format, as later explained. 

[0072] If there exist two Real PlayLists 1 , 2 and clips 1 , 2 associated with the respective Real PlayLtsts, the user 

specifies a preset domain in the Real PlayList 1 (domain from INI to OUT1: Playitem 1) as the playback domain, and 
20 also specifies, as the domain to be reproduced next, a preset domain in the Real PlayList 2 (domain from IN2 to OUT2: 

Playitem 2) asthe playback domain, as shown in Fig. 6A, a sole Virtual PlayList made up of Playitem 1 and the Piayltem2 

is prepared, as shown in Fig.6B. 

[0073] The re-editing of the Virtual PlayList is now explained. The re-edlting may be enumerated by alteration of IN- 
or OUT points in the Virtual PlayList, Insertion or appendage of new Playltems to the Virtual PlayList and deletion of 

25 Playltems in the Virtual PlayList. The Virtual PlayList itself may also be deleted. 

[0074] Fig. 7 shows the audio dubbing (post recording) to the Virtual PlayList. It is an operation of registering the 
audio post recording to the Virtual PlayList as a sub path. This audio post recording is supported by the application 
software. An additional audio stream is added as a sub path to the AV stream of the main path of the Virtual PlayList. 
[0075] Common to the Real PlayList and the Virtual PlayList is an operation of changing (moving) the playback 

30 sequence of the PlayList shown In Fig. 8. This operation is an alteration of the playback sequence of the PlayList in the 
disc (volume) and is supported by TableOfPlayList as defined in the application fomriat, as will be explained subse- 
quently with reference to e.g., Fig.20, This operation does not lead to alteration of the Clip contents. 
[0076] The mark (Mark) is now explained. The mark is provided for specifying a highlight or characteristic time In the 
Clip and in the PlayList, as shown In Fig.9. The mark added to the Clip is termed the ClipMark. The ClipMark is e.g., 

55 a program indexing point or a scene change point for specifying a characteristic scene ascribable to contents in the 
AV stream. The ClipMark is generated by e.g., the analysis unit 1 4 of Fig.1 . When the PlayList is reproduced, the mark 
of the Clip referenced by the PlayList may be referenced and used. 

[0077] The mark appended to the PlayList Is temried the PlayUstMark (play list mark). The PlayListMark is e.g., a 
bookmark point or a resuming point as set by the user. The setting of the mark to the Clip and to the PlayList is by 
40 adding a time stamp indicating the mark time point to the mark list. On the other hand, mark deletion is removing the 
time stamp of the mark from the mark list. Consequently, the AV stream is in no way changed by mark setting or by 
mark deletion. 

[0078] As another format of the ClipMark, a picture referenced by the ClipMark may be specified on the address 
basis in the AV stream. Mark setting on the Clip is by adding the address basis Information indicating the picture of the 

45 mark point to the mark list. On the other hand, mark deletion is removing the address basis information indicating the 
mark point picture from the mark list. Consequently, the AV stream is in no way changed by mark setting or by mark 
deletion. 

[0079] A thumbnail is now explained. The thumbnail Is a still picture added to the Volume, PlayList and Clip. There 
are two sorts of the thumbnail, one of them being a thumbnail as a representative picture indicating the contents. This 
50 is mainly used in a main picture in order for the user to select what the or she desired to view on acting on a cursor, 
not shown. Another sort of the thumbnail is a picture indicating a scene pointed by the mark. 

[0080] The Volume and the respective PlayLists need to own representative pictures. The representative pictures 
of the Volume are presupposed to be used for initially demonstrating a still picture representing the disc contents when 
the disc is set in position In the recording and/or reproducing apparatus 1 . It is noted that the disc means the recording 
55 medium 1 00 which is presupposed to be a of disc shape. The representative picture of the PlayList is presupposed to 
be used as a still picture for representing PlayList contents. 

[0081] As the representative picture of the PlayList, it may be contemplated to use the initial picture of the PlayList 
as the thumbnail (representative picture). However, the leading picture at the playback time of 0 is not necessarily an 
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optimum picture representing the contents. So, the user is allowed to set an optional picture as a thumbnail of the 
PlayUst. Two sorts of the thumbnails, that is the thumbnail as a representative picture indicating the Volume and the 
thumbnail as a representative picture indicating PlayList, are termed menu thumbnails. Since the menu thumbnails 
are demonstrated frequently, these thumbnails need to be read out at an elevated speed from the disc. Thus, it is 
s efficient to store the totality of the menu thumbnails in a sole file. It is unnecessary for the menu thumbnails to be 
pictures extracted from the moving pictureain the volume, but may be a picture captured from a personal computer or 
a digital still camera, as shown in Fig. 10. 

[0082] On the other hand, the Clip and the PlayList need be marlced with plural marks, whilst the pictures of the mark 
points need to be readily viewed in order to grasp the.contents of the mark positions. The picture indicating such mark 
10 point istermed amarkthumbnail. Therefore, the picture which is the original of themarkthumbnail is mainly an extracted 
mark point picture rather than a picture captured from outside. 

[0083] Fig. 11 shows the relation between the mark affixed to the PlayList and the mark thumbnail, whilst Fig. 12 
shows the relation between the mark affixed to the Clip and the mark thumbnail. In distinction from the menu thumbnail, 
the mark thumbnail is used in e.g., a sub-menu for representing details of the PlayList, while it is not requested to be 
15 read out in a short access time. So, whenever a thumbnail is required, the recording and/or reproducing apparatus 1 
opens a file and reads out a portion of the file, while there is no problem presented even if file opening and reading 
out a portion of the file by the recording and/or reproducing apparatus 1 takes some time. 

[0084] For decreasing the number of files present in a volume, it is preferred for the totality of the mark thumbnails 
to be stored in one file. While the PlayList may own one menu thumbnail and plural mark thumbnails, the user is not 
20 required to select the Clip directly (usually, the Clip is selected through PlayList), and hence there Is no necessity of 
providing menu thumbnails. 

[0085] Fig. 13 shows the relation between the menu thumbnails, mark thumbnails, PlayList and Clips. In the menu 
thumbnail file are filed menu thumbnails provided from one PlayList to another. In the menu thumbnail file is contained 
a volume thumbnail representing the contents of data recorded on the disc. In the menu thumbnail file are filed thumb- 

25 nails created from one PlayList to another and from one Clip to another. 

[0086] The CPI (Characteristic Point Information) is hereinafter explained. The CPI is data contained in the Clip 
information file and is used mainly for finding a data address in the Clip AV stream file at which to start the data readout 
when a time stamp of the access point to the Clip is afforded. In the present embodiment two sorts of the CPI are used, 
one of them being EP_map and the other being TU_map. 

30 [0087] The EP_map is a list of entry point (EP) data extracted from the elementary stream and the transport stream. 
This has the address information used to find the site of entry points in the AV stream at which to start the decoding. 
One EP data is made up of a presentation time stamp (PTS) and a data address in the AV stream of the accessing 
unit associated with the PTS, with the data address being paired to the PTS. 

[0088] The EP_map is used mainly for two purposes. First, it is used for finding a data address in the AV stream in 
35 the accessing unit referenced by the PTS in the PlayList. Second, the EP_map is used for fast forward playback or 
fast reverse playback. If, in recording the Input AV stream by the recording and/or reproducing apparatus 1 , the syntax 
of the stream can be analyzed, the EP_map is created and recorded on the disc. 

[0089] The TU__map has a list of time unit (TU) data which is derived from the arrival time point of the transport packet 
input through a digital interface. This affords the relation between the arrival-time-based time and the data address in 
40 the AV stream. When the recording and/or reproducing apparatus 1 records an input AV stream, and the syntax of the 
stream cannot be analyzed, a TU_map is created and recorded on the disc. 

[0090] The STCInfo stores the discontinuous point information in the AV stream file which stores the MPEG-2 trans- 
port stream. 

[0091] When the AV stream has discontinuous points of STC, the same PTS values may appear In the AV stream 
45 file. Thus, if a time point in the AV stream is specified on the PTS basis, the PTS pf the access point is insufficient to 
specify the point. Moreover, an index of the continuous STC domain containing the PTS is required. In this format, the 
continuous STC domain and its index are temned an STC-sequence and STC-sequence-id, respectively. The STC- 
sequence Information is defined by the STCInfo of the Clip tnfomiation file. 

[0092] The STC-sequence-id is used in an AV stream file and is optional in the AV stream file having the TU_map. 
50 [0093] The programs are each a collection of elementary streams and co-own a sole system time base for synchro- 
nized reproduction of these streams. 

[0094] It is useful for a reproducing apparatus (recording and/or reproducing apparatus 1 of Fig. 1) to know the 
contents of an AV stream prior to its decoding. These contents include e.g., values of the PID of a transport packet 
transmitting an audio or video elementary stream or the type of the video or audio components, such as HDTV video 
55 or MPEG-2 AAC audio stream. This information is useful for creating a menu screen foy illustrating to the user the 
contents of the PlayList referencing the AV stream. It is similarly useful for setting the initial state of the AV decoder 
and the demultiplexer of the respective apparatus. 

[0095] For this reason, the Clip Information file owns Programlnfo for illustrating the program contents. . 
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[0096] It may be an occurrence that program contents be changed in the AV stream file in which the M PEG-2 transport 
stream is stored. For example, the PID of the transport packet transmitting the video elementary stream may be 
changed, or the component type of the video stream may be changed from SDTV to HDTV. 

[0097] The Programlnfo stores the infomriation on change points of program contents in the AV stream file. The 
5 domain of the AV stream file in which the program contents remain constant Is termed program-sequence. 

[0098] This program-sequence is used in an AV stream file -having EP_map and is optional in an AV stream file 
having TU__map. 

[0099] The present embodiment defines the self-encoding stream format (SESF). The SESF is used for encoding 
analog input signals and for decoding digital input signals for subsequently encoding the decoded signal into an MPEG- 

10 2 transport stream. 

[01 00] The SESF defines an elementary stream pertinent to the M PEG-2 transport stream and the AV stream. When 
the recording and/or reproducing apparatus 1 encodes and records input signals in the SESF, an EP_map is created 
and recorded on the disc. 

[0101] A digital broadcast stream uses one of the following systems for recording on the recording medium 100: 
15 First, the digital broadcast stream is transcoded into an SESF stream. In this case, the recorded stream must conform 
to SESF and EP_map must be prepared and recorded on the disc. 

[0102] Alternatively, an elementary stream forming a digital broadcast stream is transcoded to a new elementary 
stream and re-multiplexed to a new transport stream conforming to the stream format prescribed by the organization 
for standardizing the digital broadcast stream. In this case, an EP_map must be created and recorded on the disc. 
20 [0103] For example. It is assumed that the input stream is an MPEG-2 transport stream conforming to the ISDB 
(standard appellation of digital BS of Japan), with the transport stream containing the HDTV video stream and the 
MPEG AAC audio stream. The HDTV video stream is transcoded to an SDTV video stream, which SDTV video stream 
and the original AAC audio stream are re-multiplexed to TS. The SDTV stream and the transport stream both need to 
conform to the ISDB format. 

25 [01 04] Another system of recording the digital broadcast stream on the recording medium 1 00 is to make transparent 
recording of the input transport stream, that is to record the Input transport stream unchanged, In which case the 
EP_map Is fonmulated and recorded on the disc. 

[01 05] Alternatively, the input transport stream is recorded transparently, that Is an input transport stream is recorded 
unchanged, in which case TU_map is created and recorded on the disc. 

30 [0106] The directory and the file are hereinafter explained. The recording and/or reproducing apparatus 1 is herein- 
after described as DVR (digital video recording). Fig.14 shows a typical directory structure on the disc. The directories 
of the disc of the DVR may be enumerated by a root directory including "DVR" directory, and the "DVR" directory, 
including "PLAYLISP" directory, "CLIPINF" directory, "M2TS" directory and "DATA" directory, as shown in Fig.14. Al- 
though directories other than these may be created below the root directory, these are discounted in the application 

35 format of the present embodiment. 

[01 07] Below the "DATA" directory, there are stored all files and directories prescribed by the DVR application format. 
The "DVR" directory includes four directories. Below the "PLAYLISP" directory are placed Real PlayList and Virtual 
PlayList database files. The latter directory may exist in a state devoid of PlayList. 

[0108] Below "CLIPINF" is placed a Clip database. This directory, too, may exist In a state devoid of AV stream files. 

40 In the "DATA" directory, there are stored files of data broadcast, such as digital TV broadcast. 

[0109] The "DVR" directory stores the following files: That Is, an "info.dvr" is created below the DVR directory to store 
the comprehensive information of an application layer Below the DVR directory, there must be a sole info.dvr. The 
filename Is assumed to be fixed to info.dvr. The "menu.thmb" stores the information pertinent to the menu thumbnails. 
Below the DVR directory, there must be 0 or 1 mark thumbnail. The filename is assumed to be fixed to "menu.thmb". 

45 If there is no menu thumbnail, this file may not exist. 

[0110] The "mark.thmb" file stores the information pertinent to the mark thumbnail picture. Below the DVR directory, 
there must be 0 or 1 mark thumbnail. The filename is assumed to be fixed to "menu.thmb". If there is no menu thumbnail, 
this file may not exist. 

[0111] The "PLAYLIST' directory stores two sorts of the PlayList files which are Real PlayList and Virtual PlayList. 
50 An "xxxxx.rpis" file stores the information pertinent to one Real PlayList. One file is created for each Real PlayList. The 
filename is "xxxxx.rpis", where "xxxxx" denotes five numerical figures from 0 to 9. A. file extender must be "rpis". 
[0112] The "yyyyy.vpis" stores the information pertinent to one Virtual PlayList. One file with a filename "yyyyy.vpis" 
is created from one Virtual PlayList to another, where "yyyyy" denotes five numerical figures from 0 to 9. A file extender 
must be "vpls". 

55 [0113] The "CLIPINF" directory stores one file in association with each AV stream file. The "zzzzz.clpi" is a Clip 
Infomnation file corresponding to one AV stream file (Clip AV stream file or Bridge-Clip stream file). The filename is 
"zzzzz.clpi", where "zzzzz" denotes five numerical figures from 0 to 9. A file extender must be "dpi". 
[01 14] The "M2TS" directory stores an AV stream file. The "zzzzz.m2ts" file is an AV stream file handled by the DVR 
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system. This is a Clip AV stream file or a Bridge-Clip AV stream file. The filename is "Z2222:m2ts", where "22222" 
denotes five numerical figures from 0 to 9. A file extender must be "m2ts". 

[0115] The "DATA" directory stores data transmitted from data broadcasting. This data may, for example, be XML 
or MPEG files. 

5 [0116] The syntax and the semantics of each directory (file) are now explained. Flg.15 shows the syntax of the "info, 
dvr" file. The "info.dvr" file is made up of three objects, that is DVRVoume(), TabieOf PlayListsQ and Makers PrivateData 

()■ 

[0117] The syntax of info.dvr shown in Flg.15 is explained. TheTableOfPlayLists_Start_address indicates the leading 
address of the TableOfPlayLlstsQ in terms of the relative number of bytes from the leading byte of the "info.dvr" file. 

10 The relative number of bytes is counted beginning from 0. 

[0118] The Makers PrivateData_Start_address indicates the leading address of the MakersPrivateDataQ, in terms 
of the relative number of bytes as from the leading byte of the "info.dvr" file. The relative number of bytes is counted 
from 0. The padding_word is inserted in association with the syntax of "Info.dvr". N1 and N2 are optional positive 
integers. Each padding word may assume an optional value. 

15 [0119] The DVRVolumeQ stores the information stating the contents of the volume (disc). Fig.1 6 shows the syntax 
of the DVRVolume. The syntax of the DVRVolumeQ, shown in Fig. 16, is now explained. The version_n umber indicates 
four character letters indicting the version numbers of the DVRVolume(). The version_number is encoded to "0045" in 
association with IS0646. 

[0120] Length is denoted by 32-bit unsigned integers indicating the number of bytes. from directly after the length 
20 field to the trailing end of DVRVolumeQ. 

[0121] The ResumeVolumeQ memori2es the filename of the Real PlayList or the Virtual PlayList reproduced last in 
the Volume. However, the playback position when the user has interrupted playback of the Real PlayList or the Virtual 
PlayList is stored in the resume-mark defined in the PlayLlstMarkQ (see Figs. 42 and 43). 

[0122] Fig.1 7 shows the syntax of the ResumeVolumeQ. The syntax of the ResumeVolumeQ shown in Fig.1 7 Is 
25 explained. The valid_flag indicates that the resume_PlayList_name field is valid or invalid when this 1 -bit flag is set to 
1 or 0, respectively. 

[0123] The 1 0-byte field of resume_PlayList_name indicates the filename of the Real PlayList or the Virtual PlayList 
to be resumed. 

[0124] The UlApp Info Volume in the syntax of the DVRVolumeQ, shown in Fig.1 6, stores parameters of the user 
30 interface application concerning the Volume. Fig.1 8 shows the syntax of the UlApplnfoVolume, the semantics of which 
are now explained. The 8-bit field of character_set indicates the encoding method for character letters encoded in the 
Volume_name field. The encoding method corresponds to the values shown in Fig.1 9. 

[0125] The 8-bit field of the namejength indicates the byte length of the Volume name indicated in the Volume_name 
field. The Volume_name field indicates the appellation of the Volume. The number of bytes of the number of the 

35 namejength counted from left of the field is the number of valid characters and indicates the volume appellation. The 
values next following these valid character letters may be any values. 

[0126] The Volume_protect_flag is a flag indicating whether or not the contents in the Volume can be shown to the 
user without limitations. If this flag is set to 1 , the contents of the Volume are allowed to be presented (reproduced) to 
the user only in case the user has succeeded in correctly inputting the PIN number (password). If this flag is set to 0, 

40 thecontentsof the Volume are allowed to be presented to the user even in case the PIN number is not input by the user. 
[0127] If, when the user has inserted a disc into a player, this flag has been set to 0, or the flag, is- set to 1 but the 
user has succeeded in correctly inputting the PIN number, the recording and/or reproducing apparatus 1 demonstrates 
a list of the PlayList in the disc. The limitations on reproduction of the respective PlayLists are irrelevant to the 
Volume_protect_flag and are indicated by playback_control_flag defined in the UlApplnfoVolume. 

45 [0128] The PIN is made up of four numerical figures of from 0 to 9, each of which is coded In accordance with ISO/ 
lEC 646. The ref_thumbnalUndex field indicates the information of a thumbnail picture added to the Volume. If the 
ref_thumbnaiLindex field is of a value other than OxFFFF, a thumbnail picture is added to the Volume. The thumbnail 
picture is stored in a menu.thumb file. The picture is referenced using the value of the ref_thumbnaiUndex in the menu, 
thumb file. If the ref_thumbnail_index field is OxFFFF, it indicates that a thumbnail picture has been added to the Volume. 

50 [0129] The TableOfPlayListQ in the info.dvr syntax shown in Fig.1 5 is explained. The TableOfPlayListQ stores the 
filename of the PlayList (Real PlayList and Virtual PlayList). All PlayList files recorded in the Volume are contained in 
the TableOfPlayListQ, which TableOfPlayListQ indicates the playback sequence of the default of the PlayList in the 
Volume. 

[0130] Fig. 20 shows the syntax of the TableOfPlayListQ, which is now explained. The version_number of the Table- 
ts OfPlayListQ indicates four character letters indicating the version numbers of the TableOf PlayLists. The 
version_number must be encoded to "0045" in accordance with ISO 646. 

[0131] Length is a unsigned 32-bit integer indicating the number of bytes of the TableOfPlayListQ from directly after 
the length field to the trailing end of the TableOfPlayListQ. TTie 16-bit field of the number_of_Play Lists indicates the 
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number of loops of the for-loop inclusive of the PlayList_file_name. This numerical figure must be equal to the number 
of PlayLists recorded in the Volume. The 1 0-byte numerical figure of the PlayList_file_name indicates the filename of 
the PlayLists. 

[0132] Fig.21 shows another configuration ofthe syntax of the TableOfPlayListQ. The syntax shown In Fig,21 is com- 
5 prised of the syntax shown in Flg.20 in which is contained the UlApplnfoPlayList. By such structure including the 
UlApplnfoPlayList, It becomes possible to create a menu picture simply on reading out the TableOfPiayLists. The 
following explanation is premised on the use ofthe syntax shown in Fig.20. 

[0133] The MakersPrivateData in the info.dvr shown in Fig. 15 is explained. The MakersPrivateData is provided to 
permit the maker of the recording and/or reproducing apparatus 1 to insert private data of the maker in the MakersPri.- 

10 vateDataO for special applications of different companies. The private data of each maker has standardized maker_ID 
for Identifying the maker who has defined it. The Makers PrivateDataQ may contain one or more maker_ID. 
[0134] If a preset maker intends to insert private data, and the private data of a different maker is already contained 
in the MakersPrivateDataQ, the new private data is added to the MakersPrivateData() without erasing the pre-existing 
old private data. Thus, in the present embodiment, private data of plural makers can be contained In one MakersPri- 

15 vateData(). 

[0135] Fig. 22 shows the syntax of the MakersPrivateData. The syntax of the MakersPrivateData shown in Fig. 22 is 
explained. The version_number ofthe TableOfPlayListQ indicates four character letters indicating the version numbers 
of the TableOfPiayLists. The version_n umber must be encoded to "0045" in accordance with ISO 646. Length Is a 
unsigned 32-blt integer Indicating the number of bytes of the TableOfPlayListQ from directly after the length field to the 

20 trailing end ofthe MakersPrivateDataQ. 

[0136] The mpd_blocks_start_ad dress indicates the leading end address of the first mpd_blockQ in terms of the 
relative number of bytes from the leading byte of the MakersPrivateDataQ. The number_of_maker_entries is the 1 6-blt 
codeless integer affording the number of entries of the maker private data included in the MakersPrivateDataQ. There 
must not be present two or more maker private data having the same maker_ID values in the MakersPrivateDataQ. 

25 [0137] The mpd_blocks_size is a 1 6-bit unsigned Integer affording one mpd_block size in terms of 1 024 bytes as a 
unit. For example, if mpd_block_size = 1, It indicates that the size of one mpd_block is 1024 bytes. The 
number_of_mpd_blocks is a 1 6-bit unsigned integer affording the number of mpd_blocks contained in the MakersPri- 
vateDataQ. The makerJD is the 1 6-bit unsigned integer indicating the model number code of the DVR system which 
has created the maker private data. The value encoded to the maker_tD is specified by the licensor. 

30 [0138] The maker_model_code is a 16-bit unsigned integer Indicating the model number code of the DVR system 
which has created the maker private data. The value encoded to the maker_model_code is set by the maker who has 
received the license of the format. The start_mpd_block_n umber is a 1 6-bit unsigned integer indicating the number of 
the mpd_block number at which begins the maker private data. The leading end of the maker private data must be 
aligned with the leading end of the mpd_block. The start__mpd_block_n umber corresponds to a variable j in the for- 

35 loop of the mpd_block. 

[0139] The mpdjength is a 32-bit unsigned integer indicating the size of the maker private data. The mpd^block is 
an area in which is stored maker private data. All of the mpd_blocks in the MakersPrivateDataQ must be of the same 
size. 

[0140] The real PlayLlst file and the Virtual PlayList file, In other words, xxxxx.rpis and yyyyy vpls, are explained, 
40 Fig. 23 shows the syntax of xxxxx.rpis (Real PlayList) and yyyyy vpls (Virtual PlayLlst), which are of the same syntax 
structure. Each of the xxxxx.rpis and yyyyy vpls is made up of three objects, that is PlayListQ, PlayListMarkQ and 
M akersP rivateDataQ . 

[0141] The PlayListMark_Start_address indicates the leading address of the PlayListMarkQ, in terms of the relative 
number of bytes from the leading end of the PlayList file as a unit. The relative number of bytes is counted from zero. 
45 [0142] The Makers PrivateData_Start__address indicates the leading address of the MakersPrivateDataQ, in terms 
of the relative number of bytes from the leading end ofthe PiayList file as a unit. The relative number of bytes is counted 
from zero. 

[0143] The padding_word (padding word) is inserted in accordance with the syntax of the PlayList file, with N1 and 

N2 being optional positive integers. Each padding word may assume an optional value. 
50 [0144] PlayList will be further explained in the following although it has been explained briefly. A playback domain 
in all Clips except Bridge-Clip must be referred by all PlayLists in the disc. Also, two or more Real PlayLists must not 
overiap the playback domains shown by their Playltems In the same Clip. 

[0145] Reference is made to Figs.24A, 24B and 24C. For all Clips, there exist corresponding Real PlayLists, as 

shown in Fig.24A. This rule Is observed even after the editing operation has come to a close, as shown in Fig.24B. 
55 Therefore, all Clips must be viewed by referencing one of Real PlayLists. 

[0146] Referring to Fig.24C, the playback domain of the Virtual PlayList must be contained in the playback domain 
and in the Bridge-Clip playback domain. There must not be present in the disc Bridge-Clip not referenced by any Virtual 
PlayList. 
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[0147] The Real PlayLlst, containing tlie list of the Playltenn, must not contain SubPlayltem. The Virtual PlayList 
contains the Playltem list and, If the CPLtype contained In the PlayLlstQ is the EP_map type and the PlayLlst_type is 
0 (PlayLlst containing video and audio) , the Virtual PlayList may contain one SubPlayltem. In the PlayLlstQ in the 
present embodiment, the SubPlayltem is used only for audio post recording. The number of the SubPlayltems owned 
by one Virtual PlayList must be 0 or 1 . 

[0148] The PlayList is hereinafter explained. Fig. 25 shows the PlayList syntax which is now explained. The 
version_n umber indicates four character letters indicting the version numbers of the PlayList(). The verslon_number 
is encoded to "0045" in association with ISO 646. Length is a 32-bit unsigned integer .indicating the total number of 
byte of the PlayList() as from directly after the length field to the trailing end of the PlayListfl. The PlayList_type, one 
example of which is shown in Fig.26, is an 8-blt field Indicating the PlayList type. 

[0149] The CPI_type is one-bit flag indicating the value of the CPI_type of the Clip referenced by the PlayltemQ and 
by the SubPlayltem(). The CPI_types defined in the CPIs of all Clips referenced by one PlayLlst must be of the same 
values. The number_of_Play Items is a 16-bit field indicating the number of Playltems present in the PlayList. 
[0150] The Playltemjd corresponding to the preset PlayltemQ is defined by the sequence in which the PlayltemQ 
appears In the for-loop containing the PlayltemQ. The Playltemjd begins with 0. The nimber_of_SubPlayltems is a 
16-bit field indicating the number of SubPlayltem in the PlayList. This value is 0 or 1 . An additional audio stream path 
(audio stream path) is a sort of a sub path. 

[0151] The UlApplnfoPlayList of the PlayList syntax shown in Fig.25 is explained. The UlApp Info PlayList stores 
parameters of the user interface application conceming the PlayLlst. Fig.27 shows the syntax of the UlApplnfoPlayList, 
which is now explained. The character_set is an 8-bit field indicating the method for encoding character letters encoded 
In the PlayList_name field. The encoding method corresponds to the values confomning to the table shown in Fig. 19. 
[0152] The namejength is an 8-bit field indicating the byte length of the PlayList name indicated in the PlayList_name 
field. The PlayList_name field shows the appellation of the PlayList. The number of bytes of the number of the 
name_length counted from left of the field is the number of valid characters and indicates the PlayList appellation. The 
values next following these valid character letters may be any values. 

[0153] The record_time_and_date is a 56-bit field storing the date and time on which the PlayList was recorded. This 
field is 14 numerical figures for year/ month/ day/ hour/minute/ second encoded In binary coded decimal (BCD). For 
example, 2001/12/23:01 :02:03 is encoded to "0x20011223010203". 

[0154] The duration is a 24-bit field indicating the total replay time of the PlayList in terms of hour/ minute/ second 
as a unit. This field is six numerical figures encoded in binary coded decimal (BCD). For example, 01 :45:30 is encoded 
to "0x014530". 

[0155] The valid_period is a 32-bit field indicating the valid time periods of the PlayList This field is 8 numerical 
figures encoded in 4-bit binary coded decimal (BCD). The valid_period is used in the recording and/or reproducing 
apparatus 1 e.g., when the PlayList, for which the valid period has lapsed, is to be automatically erased. For example, 
2001/05/07 is encoded to "0x20010507". 

[0156] The maker_ID is a 16-bit unsigned integer indicating the maker of the DVR player (recording and/or repro- 
ducing apparatus 1) which has been the last to update its PlayList. The value encoded to makerJD is assigned to the 
licensor of the DVR format. The maker_code is a 16-bit unsigned integer indicating the model number of the DVR 
player which has been the last to update the PlayList. The value encoded to the maker_code Is detemnlned by the 
maker who has received the license of the DVR format. 

[0157] If the flag of the playback^controMlag is set to 1 , its PlayList is reproduced only when the user successfully 
entered the PIN number. If this flag is set to 0, the user may view the PlayList without the necessity of inputting the 
PIN number 

[0158] If the write_protect_flag is set to 1, the contents of the PlayList are not erased nor changed except the 
write_protect_flag. If this flag is set to 0, the user is free to erase or change the PlayList. If this flag is set to 1 , the 
recording and/or reproducing apparatus 1 demonstrates a message requesting, re-confimnation by the user before the 
user proceeds to erase, edit or overwrite the PlayList. 

[0159] The Real PlayList, in which the write_protect_flag is set to 0, may exist, the Virtual PlayList, referencing the 
Clip of the Real PlayList may exist, and the write__protect_flag of the Virtual PlayList may be set to 1 . If the user is 
desirous to erase the Real PlayList, the recording and/or reproducing apparatus 1 issues an alarm to the user as to 
the presence of the aforementioned Virtual PlayList or "minimizes" the Real PlayList before erasing the Real PlayList. 
[0160] If is_played_flag is set to 1 , as shown in Fig.28B, it indicates that the PlayList was reproduced at least once 
since it was recorded, whereas, if It is set to 0, it indicates that the PlayLlst was not reproduced even once since it was 
recorded. 

[0161] Archive is a two-bit field indicating whether the PlayList is an original or a copy, as shown in Flg.2BC. The 
field of ref_thumbnaiLindex indicates the infomnation of a thumbnail picture representative of the PlayList. If the 
ref_thumbnaiUndex field is of a value other than OxFFFF, a thumbnail picture representative of the PlayList is added 
in the PlayList, with the PlayList being stored in the menu.thmb file. The picture is referenced using the value of 
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reMhumbnailJndex in the menu.thmb file. If the ref_thumbnalljndex field is OxFFFF, no thumbnail picture represent- 
ative of the Play List is added in the PlayLlst. 

[0162] The Play Item is hereinafter explained. One PlayltemQ basically contains the following data: 
Clip_lnformation_file_nanDe for specifying the filename of the Clip, IN-tlme and OUT-time, paired together to specify 
5 the playback domain of Clip, STC_sequence_id referenced by IN-tlme and OUT-time in case the CPLtype defined in 
PlayListO is EP_map type, and Connectlon„Conditlon indicating the connection condition of previous Playltem and 
current Playltem. 

[0163] If PlayList is made up of two or more Playltems, these Playltems are arrayed in a row, without temporal gap 
or overlap, on the global time axis of the PlayList. If CPLtype defined In the PlayList is EP_map type and the current 

10 PlayList does not have the BridgeSequence(), the IN-time and OUT-time pair must indicate the same time on the STC 
continuous domain as that specified by the STC_sequence_id. Such instance is shown in Fig. 29. 
[0164] Fig.30 shows such a case in which the CPLtype defined by PlayListQ and, if the current Playltem has the 
BrIdgeSequenceO, the rules as now explained are applied. The IN_time of the Playltem previous to the current Play- 
ltem, shown as IN_tlme1, Indicates the time in Bridge-Clip specified in the BridgeSequencelnfo() of the current Play- 

15 Item. This OUT_time must obey the encoding limitations which will be explained subsequently. 

[0165] The IN_time of the current Playltem, shown as IN_time2, indicates the time in Bridge-Clip specified In the 
BridgeSequencelnfoQ of the current Playltem. This IN^time also must obey the encoding limitations as later explained. 
The OUT_time of Playltem of the current Playltem, shown as OUT_time2, indicates the time on the STC continuous 
domain specified by STC_sequenbce_id of the current Playltem. 

20 [01 66] If the CPLtype of PlayListQ is TU_map type, the lN_time and OUT_time of Playltem, paired together. Indicate 
the time on the same Clio AV stream, as shown in Fig. 31 . 

[0167] The Playltem syntax is as shown In Fig.32. As to the syntax of the Playltem, shown in Fig.32, the field of the 
Clip Jnformatlon_file_name indicates the filename of the Clip Infomnation. The Cllp_stream_type defined by the Cliplnfo 
0 of this Clip Information file must indicate the Clip AV stream. 
25 [0168] The STC_sequence_id is an 8-bit field and indicates the STC_sequence_id of the continuous STC domain 
referenced by the Playltem. If the CPLtype specified in the PlayList() is TU_map type, this 8-bit field has no meaning 
and is set to 0. lN_time is a 32-bit field and used to store the playback start time of Playltem. The semantics of IN_time 
differs with CPLtype defined in the PlayList(), as shown in Fig.33. 

[01 69] OUT_tlme Is a 32-bit field and is used to store the playback end time of Playltem. The semantics of OUT_time 
30 differs with CPLtype defined in the PlayList(), as shown in Fig. 34. 

[0170] Connectlon_condition Is a 2-bit field indicating the connection condition between the previous Playltem and 
the current Playltem, as shown in Fig.35. Figs.36A to 36D illustrate various states of Connection_conditjon shown in 
Fig.35. 

[0171] BrIdgeSequencelnfo is explained with reference to Fig.37. This BridgeSequencelnfo is the ancillary informa- 

35 tion of the current Playltem and includes the following infomnation. That Is, BridgeSequencelnfo includes 
Bridge_Clip_lnformation_file_name for specifying the Bridge_Clip AV file and a Bridge_ClipJnformation_file_name 
specifying the corresponding Clip Information file (Fig. 45). 

[0172] It is also an address of a source packet on the Clip AV stream referenced by the previous Playltem. Next to 
this source packet is connected the first source packet of the Bridge-Clip AV stream. This address is termed the 
40 RSPN_exlt_from_previous_Clip. It is also an address of the source packet on the Clip AV stream referenced by the 
current Playltem. Ahead of this source packet is connected the last source packet of the Bridge_clip AV stream file. 
This address is termed RSPN_enter_to_current_Clip. 

[0173] In Fig.37, RSPN_arrivaLtime_discontinuity indicates an address of a source packet in the Bridge_Cfip AV 
stream where there is a discontinuous point in the arrival time base. This address is defined in the Cliplnfo() (Fig. 46). 
45 [0174] Fig. 38 shows the syntax of the BridgeSequencelnfo. Turning to the syntax of BridgeSequencelnfo shown in 
Fig. 38, the field of Bridge_Clip_lnformation_file_name indicates the filename of the Clip Information file corresponding 
to the Bridge_Clip_lnformation_file. The Clip_stream_type defined in Cllplnfo() of this Clip information file must indicate 
'Bridge_Clip AV stream'. 

[0175] The 32-bit field of the RSPN_exit_from_previous_Clip is a relative address of a source packet on the Clip AV 
so stream referenced by the previous Playltem. Next to this source packet is connected the first source packet of the 
Bridge_Clip AV stream file. The RSPN_exit_from_previous_Clip has a size based on the source packet number as a 
unit, and is counted with the value of the offset_SPN defined in the Cllplnfo() from the first source packet of the Clip 
AV stream file referenced by the previous Playltem. 

[0176] The 32-bit field of RSPN_enter_to_curent_Cllp is the relative address of the source packet on the Clip AV 
55 stream referenced by the current Playltem. Ahead of this source packet is connected the last source packet of the 
Bridge_Clip_AV stream file. The RSPN_enter_to_curent_Clip has a size that is based on the source packet number 
as a unit. The RSPN_enter_to_curent_Clip is counted with the value of the offset_SPN, defined in the ClipInfo() from 
the first source packet of the Clip AV stream file referenced by the current Playltem, as an initial value. 
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[0177] The SubPlayltem Is explained with reference to Fig.39, The use of SubPlay!tem() is permitted only if the 
CPLtype of the PlayListQ is the EP„map type. In the present embodiment, SubPlayltem Is used only for audio post 
recording. The SubPlayltem() includes the following data. First, it includes ClipJnformation_file„name for specifying 
the Clip referenced by the sub path In the PlayLlst. 

5 [0178] It also includes SubPath_lN_time and SubPath_OUT_time for specifying the sub path playback domain in 
the Clip. Additionally, it includes sync_Playltem_id and start_PTS_of_Playltem for specifying the time of starting the 
sub path reproduction on the main path time axis. The Clip AV stream, referenced by the sub path, must not contain 
STC discontinuous points (discontinuous points of the system time base). The clocks of audio samples of the Clip used 
In the sub path are locked to the clocks of the audio samples of the main path. 

10 [0179] Fig.40 shows the syntax of the SubPlayltem. Turning to the syntax of the SubPlayltem, shown in Fig.40, the 
field of the Clip_lnformation_file_name indicates the filename of the Clip Information file and is used by a sub path in 
the PlayLlst. The Cllp_stream_type defined in this CliplnfoQ must indicate the Clip AV stream. 
[0180] An 8-bit field of sync_PlayltemJd indicates the sub path type. Here, only '0x00' is set, as shown in Fig.41 , 
while other values are reserved for future use. 

15 [0181] The 8-bit field of sync_PlayltemJd indicates the Playltem_id of the Playltem containing the time of playback 
start of the sub path on the time axis of the main path. The value of Playltemjd corresponding to the preset Playltem 
is defined In the PlayListQ (Fig.25). 

[0182] A 32-bit field of sync__start_PTS_of_P lay Item denotes the time of playback start of the sub path on the time 
axis of the main path, and denotes the upper 32 bits of the PTS (presentation time stamp) on the Playltem referenced 
20 by the sync_Playltem_id. The upper 32 bitfield of the SubPath_IN_time stores the playback start time of the sub path. 
SubPath_IN_time denotes upper 32 bits of the PTS of 33 bits corresponding to the first presentation unit in the sub path . 
[0183] The upper 32 bitfield of subPath_OUT_time stores the playback end time of the sub path. SubPath_OUT_time 
indbates upper 32 bits of the value of the Presentatlon_end_TS calculated by the following equation: 

25 

Presentation_end_TS = PTS_OUT + AU_duration 

where PTS_out Is the PTS of the 33 bit length corresponding to the last presentation unit of the SubPath and 
AU_duration is the 90 kHz based display period of the last presentation unit of the SubPath. 

30 [0184] Next, PlayLlstMarkO In the syntax of xxxxx.rpis and yyyyy.vpis shown in Fig .23 is explained. The mark infor- 
mation pertinent to the PlayLlst is stored in this PlayListMark. Fig. 42 shows the syntax of PlayListMark. Turning to the 
syntax of the PlayListMark shown in Fig. 42, version_number is four character letters indicating the version number of 
this PlayListMark(). The version_number must be encoded to "0045" in accordance with ISO 646. 
[0185] Length is an unsigned 32-bit integer indicating the number of bytes of PlayListMark() from directly after the 

35 length field to the trailing end of the PlayListMark(). The number_of_PlayListMarks is a 1 6-bit unsigned integer indicating 
the number of marks stored in the PlayListMark. The number_of_PlayLlstMarks may be zero. The mark_type is an 
8-bit field indicating the mark type and is encoded in the table shown In Fig. 43. 

[01 86] A 32-bit filed of mark_time_stamp stores a time stamp indicating the point specified by the mark. The seman- 
tics of the mark_tlme_stamp differ with CPLtype defined in the PlayList(), as shown in Fig. 44. The Playltemjd is an 
40 8-blt field specifying the Playltem where the mark is put. The values of Playltemjd corresponding to a preset Playltem 
is defined in the PlayLlst() (see Fig. 25). 

[0187] An 8-bit field of character_set shows the encoding method of character letters encoded in the mark_name 
field. The encoding method corresponds to values shown in Fig. 19. The 8-bit field of namejength indicates the byte 
length of the mark name shown in the mark_name field. The mark_name field denotes the mark name indicated in the 
45 mark_name field. The number of bytes corresponding to the number of name_lengths from left of this field is the 
effective character letters and denotes the mark name. In the mark_name field, the value next following these effective 
character letters may be arbitrary. 

[0188] The field of the ref Jhumbnailjndex denotes the information of the thumbnail picture added to the mark. If 
the field of the ref Jhumbnailjndex is not OxFFFF, a thumbnail picture is added to its mark, with the thumbnail picture 
50 being stored In the mark.thmb file. This picture is referenced in the mark.thmb file, using the value of 
ref Jhumbnailjndex, as explained subsequently. If the ref Jhumbnailjndex field is OxFFFF, it indicates that no thumb- 
nail picture is added to the mark. 

[0189] The Clip Information file is now explained. The zzzzz.clpi (Clip Information file) is made up of six objects, as 
shown in Fig.45. These are Cllplnfo(), STCJnfo(), Program(), CPI(), ClipMarkQ and Makers PrlvateData(). For the AV 
55 Stream (Clip AV stream or Bridge-Clip AV stream) and the corresponding Clip Infomnatlon file, the same string of nu- 
merals "zzzzz" is used. 

[0190] Turning to the syntax of zzzzz.clpi (Clip Information file) shown in Fig.45 Is explained. The 
CIiplnfo_Start_address indicates the leading end address of Cliplnfo() with the relative number of bytes from the leading 
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end byte of the zzzzz.clpi file as a unit. The relative number of bytes is counted from zero. 

[0191] The STC_lnfo_Start_address indicates the leading end address of STC_lnfo with the relative number of bytes 
from the leading end byte of the zzzzz.clpi file as a unit. The Program I nfo_Start__address indicates the leading end 
address of Programlnfo() with the relative number of bytes from the leading end byte of the zzzzz.clpi file as a unit. 
The relative number of bytes is counted from 0. The CPLStart_address indicates the leading end address of CPIQ 
with the relative number of bytes from the leading end byte of the zzzzz.clpi file as a unit. The relative number of bytes 
Is counted from zero. 

[01 92] The ClipMark_Start_address indicates the leading end address of ClipMark() with the relative number of bytes 
from the leading end byte of the zzzzz.clpi file as a unit. The relative number of bytes Is counted from zero. 
The_MakersPrivateData Start_address indicates the leading end address of MakersPrivateDataQ with the relative 
number of bytes from the leading end byte of the zzzzz.clpi file as a unit. The relative number of bytes is counted from 
zero. The paddlng_word Is inserted in accordance with the syntax of the zzzzz.clpi file. N1 , N2, N3, N4 and N5 must 
be zero or optional positive integers. The respective padding words may also assume optional values. 
[0193] The Cliplnfo is now explained. Fig.46 shows the syntax of Cliplnfo. Fig.46 shows the syntax of Cliplnfo. In 
the CliplnfoO is stored the attribute infonnation of corresponding AV stream files (Clip AV stream or Bridge-Clip AV 
stream file). 

[0194] Turning to the syntax of the Cliplnfo shown in Fig.46, version_number is the four character letters Indicating 
the version number of this Cliplnfo(). The verslon_number must be encoded to "0045" in accordance with the ISO 646. 
Length is a 32 -bit unsigned integer indicating the number of bytes of CliplnfoQ from directly at back of the length field 

to the trailing end of the Cliplnfo(). An 8-bit field of Clip_stream_type indicates the type of the AV stream corresponding 
to the Clip Information file, as shown In Fig.47. The stream types of the respective AV streams will be explained sub- 
sequently. 

[0195] The 32-bit field of offset_SPN gives an offset value of the source packet number of the first source packet 
number of the first source packet of the AV stream (Clip AV stream or the Bridge-Clip AV stream). When the AV stream 

file is first recorded on the disc, this offset_SPN must be zero. 

[0196] Referring to Fig.48, when the beginning portion of the AV stream file is erased by editing, offset_SPN may 
assume a value other than 0. In the present embodiment, the relative source packet number (relative address) refer- 
encing the offset__SPN is frequently described in. the fomi of RSPNxxx, where xxx is modified such that RSPN_xxx is 
RAPN_EP_start. The relative source packet number is sized with the source packet number as a unit and is counted 
from the first source packet number of the AV stream file with the value of the offset_SPN as the initial value. 
[01 97] The number of source packets from the first source packet of the AV stream file to the source packet referenced 
by the relative source packet number (SPN_xxx) is calculated by the following equation: 

SPN_xxx = RSPN_xxx - offset_SPN. 
Fig.48 shows an instance in which offset_SPN is 4. 

[0198] TS_recordlng_rate is a 24-bit unsigned integer, which affords an input/output bit rate required for the AV 
stream to the DVR drive (write unit 22) or from the DVR drive (readout unit 28). The record_time_and_date is a 56-bit 
field for storing the date and time of recording of the AV stream corresponding to the Clip and is an encoded represen- 
tation of year/month/day/hour/minute in 4-bit binary coded decimal (BCD) for 14 numerical figures. For example, 
2001/2/23:01:02:03 is encoded to "0x20011223010203". 

[0199] The duration is a 24-bit field indicating the total playback time of the Clip by hour/minute/second based on 
arrival time clocks. This field is six numerical figures encoded in 4-bit binary coded decimal (BCD). For example, 01 : 
45:30 is encoded to "0x014530". 

[0200] A flag time_controlled_flag indicates the recording mode of an AV stream file. If this time_controlled_flag Is 
1 , it indicates that the recording mode is such a mode in which the file size is proportionate to the time elapsed since 
recording, such that the condition shown by the following equation: 

Ts_average_rate*1 92/1 88*(t - start_time)- a <= slze_clip(t) 
<= TS_average_rate*1 92/1 88* (t - start_time) + a 

where TS_average_rate Is an average bit rate of the transport stream of the AV stream file expressed by bytes/second. 
[0201] In the above equation, t denotes the time in seconds, while start_time Is the time point when the first source 
packet of the AV stream file was recorded. The size_clip(t) is 10*192 bytes and a is a constant dependent on 
TS_average_rate. 
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[0202] If time_controlled_flag is set to 0, it indicates that the recording mode is not controlling so that the time lapse 
of recording is proportionate to the file size of the AV stream. For example, the input transport stream is recorded in a 
transparent fashion. 

[0203] If time_controlled_f lag Is set to 1 , the 24-bit field of TS_average_rate indicates the value of TS_average_rate 
5 used In the above equation. If time_controlled_flag is set to 0, this field has no meaning and must be set to 0. For 
example, the variable bit rate transport stream is encoded by the following sequence: First, the transport rate is set to 
the value of TS_recording_rate. The video stream is encoded with a variable bit rate. The transport packet is intermit- 
tently encoded by not employing null packets. 

[0204] The 32-bit field of RSPN_arrivaLtime_discontinuity is a relative address of a site where arrival timebase 

10 discontinuities are produced on the Bridge-Clip AV stream file. The RSPN_arrival_time_discontinuity is sized with the 
source packet number as a unit and is counted with the value of offset_SPN defined in the Cliplnfo() as from the first 
source packet of the Bridge-Clip AV stream file. An absolute address in the Bridge-Clip AV stream file is calculated 
based on the aforementioned equation: 

15 

SPN_xxx = RSPN_xxx - offset_SPN. 

[0205] The 1 44-bit field of reserver^for_system_use is reserved for a system. If is_formatJdentifier_valid flag Is 1 , 
It indicates that the field of formatjdentifier is effective. If is„format„identifier_valid flag is 1, it indicates that the 

20 format_ldentifier field is valid. If is_original_network_ID_valld flag is 1, it indicates that the field of 
is_transport_stream_ID-valid is valid. If the flag is_transport_stream_ID-valid is 1, it indicates that the 
transport_stream_ID field Is valid. If is_servece_ID_valid flag is 1 , it indicates that the serveceJD field is valid. 
[0206] If is_country code_valld flag Is 1, It indicates that the field country_code is valid. The 32-bit field of 
formatjdentifier indicates the value of fonnatjdentlfier owned by a registration descriptor (defined in ISO/I EC1 381 8-1 ) 

25 In the transport stream. The 1 6-bit field of orlglnaLnetwork_ID indicates the value of the orlginal_network_ID defined 
In the transport stream. 

[0207] The 16-bit field in servece_ID denotes the value of servece_ID defined in the transport stream. The 24-bit 
field of country__code shows a country code defined by iS031 66. Each character code is encoded by IS08859-1 . For 
example, Japan is represented as "JPN" and Is encoded to "Ox4A 0x50 0x4E". The stream_fomnat_name Is 1 5 character 
30 codes of ISO-646 showing the name of a fonriat organization affording stream definitions of transport streams. An 
invalid byte in this field has a value of 'OxFF'. 

[0208] Formatjdentifier, originaLnetwork_ID, transport_stream_ID, servece_ID, country_code and 
stream Jormat_name indicate service providers of transport streams. This allows to recognize encoding limitations on 
audio or video streams and stream definitions of private data streams other than audio video streams or SI (service 

35 information). These information can be used to check if the decoder is able to decode the stream. If such decoding is 
possible, the information may be used to initialize the decoder system before starting the decoding. 
[0209] STCJnfo Is now explained. The time domain in the MPEG-2 transport stream not containing STC discontin- 
uous points(discontinuous points of the system time base) is termed the STC^sequence. In the Clip, STC_sequence 
is specified by the value of STC_sequenceJd. Figs.50A and 50B illustrate a continuous STC domain. The same STC 

40 values never appear in the same STC_sequence, although the maximum tine length of Clip is limited, as explained 
subsequently. Therefore, the same PTS values also never appear in the same STC_sequence. If the AV stream contains 
N STC discontinuous points, where N > 0, the Clip system time base is split Into (N+l) STC_sequences. 
[021 0] STC_lnfo stores the address of the site where STC discontinuities (system timebase discontinuities) are pro- 
duced. As explained with reference to Fig.51, the RSPN_STC_start indicates the address and begins at a time point 

45 of arrival of the source packet referenced by the (k+1)st RSPN_STC_start and ends at a time point of arrival of the 
last source packet. 

[0211] Fig.52 shows the syntax of the STCJnfo. Turning to the syntax of STCJnfo shown in Fig.52, version„number 
is four character letters indicating the version number of STC_lnfo(). The version_number must be encoded to "0045" 
in accordance with ISO 646. 

50 [0212] Length Is a 32-bit unsigned integer indicating the number of bytes of STC_lnfo() from directly after this length 
field to the end of STC_lnfo. If CPI Jype of CPIQ indicates TU_map type, 0 may be set in this length field. If CPI_type 
of CPI() indicates EP_map type, the num_of_STC_sequence mut be of a value not less than 1 . 
[0213] An 8-bit unsigned integer of num_of_STC_sequence indicates the number of sequences in the Clip. This 
value indicates the number of thefor-loops next following the field. The STC_sequenceJd corresponding to the preset 

55 STC_sequence is defined by the order in which appears the RSPN_STC_start corresponding to the STC_sequence 
in the for-loop containing the RSPN_STC_start. The STC_sequence_id commences at 0. 

[0214] The 32-bit field of RSPN_STC_start indicates an address at which the STC_sequence commences on the 
AV stream file. RSPN_STC_start denotes an address where system time base discontinuities are produced in the AV 
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stream file. The RSPN_STC_start may also be a relative address of the source packet having the first PGR of the new 
system time base in the AV stream. The RSPN_STC__start Is of a size based on the source packet number and is 
counted from the first source packet of the AV stream file with the offset_SPN value defined in Cliplnfo() as an initial 
value. In this AV stream file, the absolute address is calculated by the above-mentioned equation, that is 

5 

SPN_xxx = RSPN_xxx - offset_SPN. 

[0215] Programlnfo in the syntax of zzzz.clip shown in Fig.45 is now explained with reference to Fig.53. The time 
to domain having the following features in the Clip is temied program_sequence. These feature are that the value of 
PCR_PID is not changed, the number of audio elementary streams is also not changed, the PID values in the respective 
video streams are not changed, the encoding information which is defined by VideoCodinglnfo thereof is not changed, 
the number of audio elementary streams is also not changed, the PID values of the respective audio streams are not 
changed, and that the encoding information, which is defined by AudioCodinglnfo thereof, is not changed. 
IS [0216] Program_sequence has only one system time base at the same time point. Program_sequence has a sole 
PMT at the same time point. Program lnfo() stores the address of the site where the program_sequence commences. 
RSPN_program_sequence-start indicates the address. 

[0217] Fig.54 illustrates the syntax of Programlnfo. Turning to the Programlnfo shown in Fig.54, vers lon_n umber is 
four character letters indicating the version number of ProgramlnfoQ. The version__number must be encoded to "0045" 

20 in accordance with ISO 646. 

[0218] Length is a 32-bit unsigned integer indicating the number of bytes of ProgramlnfoQ from directly at back of 
this length field to the end of program(info(). If CPI_type of CPI() indicates the TU_map type, this length field may be 
set to 0. If the-GPLtype of CPI() Indicates EP_map type, the number_of_programs must be of a value not less than 1 . 
[0219] An 8-bit unsigned integer of number_of_program_sequences denotes the number of program_sequences in 

25 the Glip. This value Indicates the number of for-loops next following this field. If program_sequence in the Clip Is not 
changed, 1 must be set in the number of program_sequences. A 32-bit field of RSPN _program_sequence_start is a 
relative address where the program sequence commences on the AV stream. 

[0220] RSPN_program_sequence_start is sized with the source packet number as a unit and is counted with the 
value of offset_SPN defined in the Cliplnfo() as from the first source packet of the AV stream file. An absolute address 
30 in the AV stream file is calculated by: 

SPN_xxx = RSPN_xxx - offset.SPN. 

35 The values of RSPN_program_sequence_start in the for-loop syntax must appear in the rising order 

[0221] A 1 6-bit field of PCR_PID denotes the PID of the transport packet containing an effective PGR field effective 
for the program_sequence. An 8-bit field of number_of_audios Indicates the number of for-loops containing 
audio_stream_P!D and AudioCodinglnfoQ. A 1 6-bit field of video_stream_PID indicates the PID of the transport packet 
containing a video stream effective for its program_sequence. VideoGodinginfo(), next following this field, must explain 

40 the contents of the video stream referenced by its video_stream_PID. 

[0222], A 1 6-bit field of audio_stream_PID indicates the PID of a transport packet containing the audio stream effective 
for its program sequence. The AudioCodlngInf o(), next following this field, must explain the contents of the video stream 
referenced by its audio_stream_PID. 

[0223] The order in which the values of vldeo_stream_PID in the for-loop of the syntax must be equal to the sequence 
45 of PID encoding of the video stream In the PMT effective for the program_sequence. Additionally, the order in which 
the values of audio_stream_PID appears in the for-loop of the syntax must be equal to the sequence of PID encoding 
of the audio stream in the PMT effective for the program_sequence. 

[0224] Fig. 55 shows the syntax of VideoCodinglnfo in the syntax of the Programlnfo shown in Fig.54. Turning to the 
syntax of the VideoGoding Info shown In Fig. 55, an 8-bit field of video_format indicates the video format corresponding 
50 to video_stream_PID In ProgramlnfoQ, as shown in Fig. 56. 

_[0225] Referring to Fig.57, an 8-bit field of frame_rate indicates the video frame rate corresponding to the 
video_stream_PID in ProgramlnfoQ. An 8-bit field of display_aspect_ratio indicates a video display aspect ratio corre- 
sponding to video_stream_PID in ProgramlnfoQ. 

[0226] Fig. 59 shows the syntax of AudioCodinglnfo in the syntax of Programlnfo shown in Fig.54. Turning to the 
55 syntax of the AudioGoding Info shown in Flg.59, an 8-bit field of audlo_format indicates the audio encoding method 
corresponding to audio_stream_PID in ProgramlnfoQ, as shown in Flg.60. 

[0227] An 8-bit field of audio_component_type indicates an audio component type corresponding to 
audio_stream_PID in ProgramlnfoQ as shown In Fig. 61 , whilst an 8-bit field of sampling_f requency indicates an audio 
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sampling frequency corresponding to audio_stream_PID in ProgramlnfoQ as shown in Fig. 62. 

[0228] The CPI (Characteristics Point Infornnation) in the syntax of zzzzz.cllp shown in Fig.45 Is explained. The CPI 
is used for correlating the tinne information in the AV stream with the address in its file. The CPI is of two types, namely 
EP_map and TU_map. In Flg.63, if CPLtype In CPIQ is EP_map, its CPI() contains EP_map. In Fig. 64, if CPLtype in 
CPI() is TU_map, its CPI() contains TU_map. One AV stream has one EP_map or one TU_map. If the AV stream is 
an SESF transport stream, the corresponding Clip must own an EP_map. 

[0229] Fig.65 show the syntax of CPI.. Turning to the syntax of CPI shown in Fig.65, the version__n umber is four 
character letters indicating the version number of this CPI(). The version_number must be encoded to "0045" In ac- 
cordance with ISO 646. Length is a 32-bit unsigned Integer indicating the number of bytes as from directly after this 
length field to the trailing end of the CPI(). The CPI_type is a 1 -bit flag and indicates the CPI type of Clip, as shown in 
Fig. 66. 

[0230] The EP_map in the CPI syntax shown in Fig.65 Is explained. There are two types of the EP_map, that is 
EP_map for a video stream and an EP_map for an audio stream. The EP_map_type in the EP_map differentiates 
between these EP_map types. If the Clip contains one or more video streams, the EP_map for the video stream must 
be used. If the Clip does not contain a video stream but contains one or more audio streams, the EP_map for the audio 
stream must be used. 

[0231] The EP_map for a video stream is explained with reference to Fig.67. The EP_map for the video stream has 
data stream_PID, PTS_EP_start and RSPN_EP_start. The stream_PID shows the PID of the transport packet trans- 
mitting a video stream.. The PTS_EP_start Indicates the PTS of an access unit beginning from the sequence header 
of the video stream. The RSPN_RP_start indicates the address of a source packet including the first byte of the access 
unit referenced by the PTS_EP_start in the AV stream. 

[0232] A sub table, termed EP_map_for_one_stream_PID() Is created from one video stream transmitted by the 
transport packet having the same PID to another. If plural video streams exist in the Clip, the EP_map may contain 
pi u ral E P_map_f o r_on e_stream_P I D () . 

[0233] The EP_map for audio stream has data stream_PID, PTS_EP_start and RSPN_EP_start. The stream_PID 
shows a PID of a transport packet transmitting an audio stream. The PTS_EP_start shows the PTS of an accessing 
unit in the audio stream. The RSPN_EP-start indicates an address of a source packet containing a first byte of the 
access unit referenced by PTS_EP_start of the AV stream. 

[0234] The sub table temried EP_map_for_one_stream_PID() is created from one audio stream transmitted by the 
transport packet having the same PID to another. If there exist plural audio streams in the Clip, EP_map may contain 
plural EP map-_for_one stream_PID(). 

[0235] Turning to the relation between EP_map and STC_lnfo, one EP_map_for_one_stream_PID() is created in 
one table in^espective of discontinuous points In the STC. Comparison of the value of the RSPN_EP_start to the value 
of RSPN_STC_start defined in STC_lnfo() reveals the boundary of data of EP_map belonging to respective 
STC_sequences (see Fig.68). The EP_map must have one EP_map_for_one_stream_PID for a continuous stream 
range transmitted by the same PID. In the case shown In Fig.69, program#1 and program#3 have the same video PID, 
however, the data range is not continuous, so that EP_map_for_one_stream_PID must be provided for each program. 
[0236] Fig. 70 shows the EP_map syntax. By way of explanation of the EP_map syntax shown In Fig. 70, the EP_type 
is a 4-bit field and shows the EP_map entry point type, as shown in Fig, 71 . The EP_type shows the semantics of the 
data field next following this field. If Clip includes one or more video stream, the EP_type must be set to 0 (Video'). 
Alternatively, if the Clip contains no video stream but contains one or more audio stream, then EP_type must be set 
to 1 ('audio'). 

[0237] The 16-bit field of number_of_stream_PIDs indicates the number of times of loops of the for-loop having 
number_of_stream_PIDs. in the EP_map() as a variable. The 16-bit field of stream_PID(k) indicates the PID of the 
transport packet transmitting the number k elementary stream (video or audio stream) referenced by 
EP_map_for_one_stream_PID (num_EP_entries(k)). If EP_type is 0 ('video'), its elementary stream must be a video 
stream. If EP_type is equal to 1 ('audio'), its elementary stream must be the audio stream. 

[0238] The 16-bit field of num_EP_entries(k) indicates the num_EP_entrles(k) referenced by EP_map_entries(k)). 
The EP_map_for_one_stream_PID_ Start_address(k): This 32-bit field indicates the relative address position at which 
the EP_map_for_one_stream_PID(num_EP_entries(k)) begins in the EP_map(). This value is indicated by the size as 
from the first byte of the EP„map(). 

[0239] Paddlng_word must be Inserted in accordance with the EP_map() syntax. X and Y must be optional positive 
integers. The respective padding words may assume any optional values. 

[0240] Fig. 72 shows the syntax of EP_map_for_one_stream_PID. By way of explanation of the syntax of the 
EP_map_for_one_stream_PID shown in Fig.72, the semantics of the 32-bit field of PTS_EP_start differs with the 
EP_type defined by EP_map(). If EP_type is equal to 0 ('video'), this field has upper 32 bits of the 33-bit precision PTS 
of the access unit beginning with a sequence header of the video stream. If the EP_type is equal to 1 ('audio'), this 
field has upper 32 bits of PTS of 33 bit precision of the access unit of the audio stream. 
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[0241] The semantics of the 32-bit field of RSPN-_EP_start differs with the EP_type defined in EP_map(). If EP_type 
is equal to 0 ('video'), this field Indicates the relative address of the source packet Including the first byte of the sequence 
header of the access unit referenced by the PTS_EP_start In the AV stream. Alternatively, if EP_type Is equal to 1 
('audio'), this field Indicates the relative address of the source packet containing the first byte In the audio stream of 
5 the access unit referenced by the PTS_EP_start In the AV stream. 

[0242] RSPN_EP_start is of a size which is based on the source packet number as a unit, and is counted from the 
first source packet of the AV stream file, with the value of the offset_SPN, defined in Cliplnfo(), as an initial value. The 
absolute address In the AV stream file Is calculated by 

10 

SPN_xxx = RSPN:,xxx - offset_SPN. 

[0243] It is noted that the value of the RSPN_EP_start in the syntax must appear in the rising order. 

[0244] The TU_map is now explained with reference to Fig.73. TU_map forms a time axis based on the source 

15 packet arrival time clock (timepiece of the arrive time base). This time axis Is temned TU_map_time_axis. The point of 
origin of TU_map_time_axis is indicated by offset_time in the TU_map(). TU_map_time_axis is divided in a preset unit 
as from offset_time, this unit being termed tlme_unlt. 

[0245] In each time_unlt In the AV stream, addresses on the AV stream file of the source packet In the first complete 
form are stored in TU_map. These addresses are temried RSPN_tlme_unlt_start. The time at which begins the k(k > 

20 o)th time_unit on the TU_map_time_axis is termed TU_start_time(k). This value is calculated based on the following 
equation: 

TU_start„time(k) = offset_time + k*time_unit_si2e. 

25 

[0246] It is noted that TU_start„time(k) has a precision of 45 kHz. 

[0247] Fig. 74 shows the syntax of TU_map. By way of explanation of the TU_map syntax shown In Fig. 74, the 32-blt 
field of offset_time gives an offset time relative to TU_map_tlme_axis. This value indicates the offset time relative to 
the first tlme_unit In the Clip. The offset_tlme Is of a size based on 45 kHz clock derived from the 27 MHz precision 
30 arrival time clocks as unit. If the AV stream is to be recorded as new Clip, offset_time must be set to 0. 

[0248] The 32-bit field of time_unlt_slze affords the size of the time_unit, and is based on 45 kHz clocks, derived 
from the 27 I^Hz precision arrival time clocks, as unit. Preferably, time_unlt_slze is not longer than one second 
(time_unlt__slze < 45000). The 32 bit field of number_of_tlme_unit_entries Indicates the number of entries stored in 
TU_map(). 

35 [0249] The 32-bit field of RSN_time_unit_start Indicates the relative address of a site in the AV stream at which 
begins each time_unit. RSN_time_unit_start is of a size based on the source packet number as unit and is counted 
with the value of offset_SPN defined in CJIplnfo() as from the first source packet of the AV stream file as an Initial value. 
The absolute address in the AV stream file ls calculated by 

40 

SPN_xxx = RSPN_xxx - offset_SPN. 

[0250] It Is noted that the value of RSN_time_unlt_start in the for-loop of the syntax must appear in the rising order 
If there is no source packet In the- number (k+1) time_unlt, the number (k-h1) RSN_tlme_unlt_start must be equal to 
45 the number k RSPN_time_unit_start. 

[0251] By way of explanation of the ClipMark in the syntax of zzzzz.clip shown in Fig.45, the ClipMark is the mark 
information pertinent to clip and Is stored In the ClipMark. This mark is not set by a user, but is set by a recorder 
(recording and/or reproducing apparatus 1). 

[0252] Fig. 75 shows the ClipMark syntax. By way of explanation of the ClipMark syntax shown in Fig.75, the 
50 versjon_number is four character letters indicating the version number of this ClipMark. The version_number must be 
encoded in accordance with ISO 646 to "0045". 

[0253] Length is a 32-bit unsigned integer indicating the number of bytes of the ClipMark() as from directly after the 
length field to the trailing end of ClipMark(). The number_of_Clip_marks is a 16-bit unsigned Integer indicating the 
number of marks stored in ClipMark and may be equal to 0. Mark_type is an 8-bit field indicating the mark type and is 
55 encoded in accordance with the table shown in Fig. 76. 

[0254] Mark_time_stamp is a 32-brt field and stores the time stamp indicating a pointer having a specified mark. The 
semantics of mark_time_stamp differs with CPI_type In the PlayList{), as shown in Fig. 77. 

[0255] If CPLtype in CPI() indicates the EP_map type, this 8-bit field indicates the STC_sequenceJd of the contin- 
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uous STC domain where there is placed mark_time_stamp. If CPLtype in CPI() indicates TU_map type, this 8-bit field 
has no meaning but is set to 0. The 8-blt field of Character_set Indicates the indicating method of character letters 
encoded in the mark_name field. The encoding method corresponds to the value shown In Fig. 19. 
[0256] The 8-bit field of name Jength Indicates the byte length of the mark name shown in the mark_.name field. This 
mark_name field Indicates the mark name. The byte number corresponding to the number of the namejength from 
left of this field is the effective character number and denotes the mark name. In the mark_name field, the values next 
following these effective character letters may be arbitrary. 

[0257] The field of ref_thumbnailjndex indicates the information of the thumbnail picture appended to the mark. If 
the ref_thumbnailjndex field is of a value different from OxFFFF, a thumbnail picture is added to its mark, with the 
thumbnail picture being stored In the mark.thumb file. This picture is referenced using the value of ref_thumbnail_lndex 
in the mark.thumb file. If the ref_thumbnalljndex field Is of a value equal to OxFFFF, a thumbnail picture is not appended 
to its mark. 

[0258] MakerPrlvateData has already been explained with reference to Fig.22 and hence is not explained here spe- 
cifically. 

[0259] Next, thumbnailjnformation is explained. A thumbnail picture is stored in a menu.thmb file or in a mark.thmb 
file. These files are of the same syntax structure and own a sole ThumbnailQ. The menu.thmb file stores a picture 
representing respective PlatyLists. The totality of menu thumbnails are stored in the sole menu.thmb file. 
[0260] The mark.thmb file stores a mark thumbnail picture, that is a picture representing a mark point. The totality 
of mark thumbnails corresponding to the totality of PlayLists and Clips are stored in the sole mark.thmb file. Since the 
thumbnails are frequently added or deleted, the operation of addition and partial deletion must be executable readily 
and speedily. Forthis reason, Thmbnail() has a block structure. Picture data Is divided into plural portions each of which 
is stored in one tn_bIock. One picture data is stored In consecutive tn_blocks. In the string of tn_blocks, there may 
exist a tn_block not in use. The byte length of a sole thumbnail picture is-varlable. 

[0261] Fig.78 shows the syntax of menu.thmb and mark.thmb and Fig.79 the syntax of Thumbnail in the syntax of 

menu.thmb and mark.thmb shown in Fig.78. By way of explanation of the syntax of Thumbnail, shown in Fig.79, 
version_number Is four character letters denoting the version number of this ThumbnailQ. Version_n umber must be 
encoded to "0045" in accordance with ISO 646. 

[0262] Length is a 32-blt unsigned integer Indicating the number of bytes of MakerPrlvateDataQ as from directly at 
back of the length field up to the trailing end of ThumbnailQ. Tu_block_start_address is a 32-bit unsigned integer 
indicating the leading end byte address of the first tn_block, in terms of the relative number of bytes as from the leading 
end byte of ThumbnailQ as a unit. The number of relative bytes is counted from 0. Number_of_thumbnalls is a 16-bit 
unsigned integer which gives the number of entries of a thumbnail picture contained In ThumbnailQ. 
[0263] Tu_block_sl2e is a 1 6-bit unsigned integer which gives the size of one tn_block, in temris of 1 024 bytes as a 
unit. If, for example, tn_block_si2e = 1 , it indicates that the size of one tn_block is 1024 bytes. Num be r_of_tn_b locks 
is a 11 6-bit unsigned Integer Indicating the number of entries of tn_block in this Thumbnail. Thumbnailjndex Is a 1 6-blt 
unsigned Integer indicating the index number of the thumbnail picture represented by the thumbnail infomriation for 
one for-loop beginning from the thumbnailjndex field. The value OxFFFF must not be used as Thumbnailjndex. This 
Thumbnailjndex is referenced by ref Jhumbnailjndex in UlApplnfoVolumeQ, UlApplnfoPlayListQ, PlayListMarkQ and 
ClipMarkQ. 

[0264] Thumbnall_pictureJormat is an 8-bit unsigned Integer representing the picture format of a thumbnail picture 
and assumes a value shown in Fig. 80. In the table, DCFand PNG are allowed only in menu.thumb. The mark thumbnail 
must assume the value of "0x00" (MPEG-2 Video 1 -picture). 

[0265] Picture_data_size is a 32-bit unsigned integer indicating the byte length of a thumbnail picture in terms of 
bytes as a unit. StartJn_block_number is a 16-bit unsigned Integer indicating the tn_block number of the tn_block 
where data of the thumbnail picture begins. The leading end of the thumbnail picture data must coincide with the leading 
end of the tn_block. The tn_block number begins from 0 and is relevant to the value of a variable k in the for-loop of 
tn_block. 

[0266] X_picture_length Is a 16-bit unsigned Integer Indicating the number of pixels in the horizontal direction of a 
frame of a thumbnail picture. Y„pictu re Jength is a 1 6-blt unsigned integer indicating the number of pixels in the vertical 
direction of a frame of a thumbnail picture. Tn_block is an area in which to store a thumbnail picture. All tn_block in 
the ThumbnailQ are of the same size (fixed length) and are of a size defined by tn_block_slxe. 
[0267] Figs. 81 A and 81 B schematically show how thumbnail picture data are stored in tn_block. If, as shown In Figs. 
81 A and 81 B, the thumbnail picture begins at the leading end of tn_block, and is of a size exceeding 1 tn_block, it is 
stored using the next following tn_block. By so doing, data with a variable length can be managed as fixed length data, 
so that the editing of deletion can be coped with by simpler processing. 

[0268] An AV stream file is now explained. The AV stream file is stored in the "M2TS" directory (Fig. 14). There are 
two types of the AV stream file, namely a Clip A stream file and a Bridge-Clip AV stream file. Both AV streams must 
be of the structure of DVR MPEG-2 transport stream file as hereinafter defined. 
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[0269] First, the DVR MPEG2 transport stream Is explained. The structure of the DVR r\/iPEG-2 transport stream is 
shown in Fig.82. The AV stream file has the structure of a DVR MPEG 2 transport stream. The DVR MPEG 2 transport 
stream is made up of an integer number of Aligned units. The size of the aligned unit is 6144 bytes (2048*3 bytes). 
The Aligned unit begins from the first byte of the source packet. The source packet is 192 bytes long. One source 
s packet is comprised of TP_extra_header and a transport packet. TP_extra_header is 4 bytes long, with the transport 
packet being 188 bytes long. 

[0270] One Aligned unit is made up of 32 source packets. The last Aligned unit in the DVR MPEG 2 transport stream 
is also made up of 32 source packets. Therefore, the DVR M PEG 2 transport stream ends at a boundary of the Aligned 
unit. If the number of the transport packets of the input transport stream recorded on a disc is not a multiple of 32, a 
10 source packet having a null packet (transport packet of PID = 0x1 FFFF) must be used as the last Aligned unit. The file 
system must not use excess information in the DVR MPEG 2 transport stream. 

[0271] Fig. 83 shows a recorder model of the DVR MPEG 2 transport stream. The recorder shown in Fig. 83 is a 
conceptual model for prescribing the recording process. The DVR MPEG 2 transport stream obeys this model. 
[0272] The input timing of the MPEG 2 transport stream is now explained. The input MPEG 2 transport stream is a 
15 full transport stream or a partial transport stream. The input MPEG 2 transport stream must obey the ISO/IEC1381 8-1 
or ISO/I EC 13818-9. The number i byte of the MPEG 2 transport stream is input simultaneously at time t(i) to T-STD 
(transport stream system target decoder provided for in SO/IEC13818-1) and to the source packetizer. Rpk is an in- 
stantaneous maximum value of the input rate of the transport packet. 

[0273] A 27 MHz PLL 52 generates a frequency of 27 MHz clock. The 27 MHz. clock frequency is locked at a value 
20 of the program clock reference (PGR) of the MPEG 2 transport stream. An arrival time clock counter 53 counts the 
pulses of the 27 MHz frequency. Arrival_time_clock(l) is a count value of the arrival time clock counter at time t(i). 
[0274] A source packetizer 54 appends TP_extra_header to the totality of the transport packets to create a source 
packet. ArrivaLtlme_stamp indicates the time when the first byte of the transport packet reaches both the T-STD and 
the source packetizer. ArrivaLtime_stamp(k) is a sampled value of the Arrival_time_clock(k) as represented by the 
25 following equation: 

arrival_time_stamp(k) = arrivaLtime_clock(k)% 230 

30 where k denotes the first byte of the transport packet. 

[0275] If the time separation between two neighboring transport packets is 230/2 7000000 sec (about 40 sec) or 
longer, the difference of the arrivaLtime_stamp of the two transport packets should be set to 230/2 7000000 sec. The 
recorder is provided for such case. 

[0276] A smoothing buffer 56 smoothes the bitrate of the input transport stream. The smoothing buffer must not 
35 overflow. Rmax is the output bitrate of the source packet from the smoothing buffer when the smoothing buffer is not 
null. If the smoothing buffer is null, the output bitrate of the smoothing buffer is 0. 

[0277] Next, the parameters of the recorder model of the DVR MPEG 2 transport stream are explained. The value 
of Rmax is given by TS_recording__rate as defined in Gllplnfo() associated with the AV stream file. This value may be 
calculated from the following equation: 

40 

Rmax = TS_recording_rate*1 92/1 88 

where the value of TS_recording_rate is of a size in bytes/second. 
45 [0278] If the input transport stream is an SESF transport stream, Rpk must be equal to TS_recordlng_rate as defined 
In CliplnfoO associated with the AV stream file. If the input transport stream is not an SESF transport stream, reference 
may be made to values defined e.g., in a descriptor of the MPEG 2 transport stream, such as 
maximum_bitrate_descriptor or partiaLstream_descriptor for this value. 

[0279] If the input transport stream is an SESF transport stream, the smoothing buffer size is 0. If the input transport 
50 stream is not an SESF transport stream, reference may be made to values defined in the descriptor of the MPEG 2 
transport stream, such as, for example, the values defined in the smoothing_buffer_descriptor, short_smoothing 
_buffer_descriptor or in the partial_transport_stream__descriptor. 

[0280] For the recorder and the player (reproducing apparatus), a sufficient size buffer needs to be provided. The 
default buffer size is 1536 bytes. 
55 [0281] Next, a player model of the DVR MPEG 2 transport stream is explained. Fig. 84 shows a player model of the 
DVR MPEG 2 transport stream. This is a conceptual model for prescribing the reproduction process. The DVR MPEG 
2 transport stream obeys this model. 

[0282] A 27 MHz X-tal 61 generates the frequency of 27 MHz. An error range of the 27MHx frequency must be ±30 
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ppm (2 7000000 + 810 Hz). The arrival time clock counter 62 Is a binary counterfor counting the pulses of the frequency 
of 27 MHz. ArrivaLtlme_clock(l) Is a count value of the arrival time clock counter at time t(i). 

[0283] In the smoothing buffer 64, Rmax Is the Input bitrate of the source packet to the smoothing buffer when the 
smoothing buffer is not fulL If the smoothing buffer is full, the input bitrate to the smoothing buffer is 0. 
5 [0284] By way of explaining the output timing of the M PEG 2 transport stream, if the arrivaLtime_stamp of the current 
source packet Is equal to 30 bits on the LSB side of arrlval_time_clock(l), the transport packet of the source packet Is 
removed from the smoothing buffer. Rpk is an instantaneous maximum value of the transport packet rate. The overflow 
of the smoothing buffer Is not allowed. 

[0285] The parameters of the player model of the DVR MPEG 2 transport stream are the same as those of the 

10 recorder model of the DVR MPEG 2 transport stream described above. 

[0286] Fig. 85 shows the syntax of the source packet. Transport jDacket() is an MPEG 2 transport stream provided 
in I SO/I EG 1381 8-1 . The syntax of TP Extra-header In the syntax of the source packet shown in Fig.85 is shown In 
Flg.86. By way of explaining the syntax of the TP_Extra-header, shown in Fig.86, copy_permissionJndicator is an 
integer representing the copying limitation of the payload of the transport packet. The copying limitation may be copy 

15 free, no more copy, copy once or copying prohibited. Fig.87 shows the relation between the value of 
copy_permissionJndicator and the mode It designates. 

[0287] Copy_permlssionJndicator Is appended to the totality of transport packets. If the input transport stream is 
recorded using the IEEE1394 digital interface, the value of copy_permissionJndicator may be associated with the 
value of EMI (encryption mode indteator). If the input transport stream Is recorded without employing the IEEE1394 

20 digital interface, the value of copy_permlssion_indicator may be associated with the value of the CGI embedded in the 
transport packet. If an analog signal input is self-encoded, the value of copy_permission_indicator may be associated 
with the value of GGMS-A of the analog signal. 

[0288] Arrival_time_stamp is an integer having a value as specified by arrivaLtlme_stamp in the following equation: 

25 

arrivaLtlme_stamp(k) = arrivaLtime_clock(k)%230. 

[0289] By way of defining the ClipAV stream, the ClipAV stream must have a structure of the DVR MPEG 2 transport 
stream defined as described above, ArrivaLtime_clock(l) must Increase continuously in the Clip AV stream. If there 
30 exists a discontinuous point of the system time base (STC base) in the Clip AV stream, arrivaLtime_clock(i) in the Clip 
AV stream must increase continuously. 

[0290] The maximum value of the different of the amval_time_clock(i) between the beginning and the end of the Clip 
AV stream must be 26 hours. This limitation guarantees that, if there is no discontinuous point in the system time base 
(STC base) in the MPEG 2 transport stream, the PTS (presentation time stamp) of the same value never appears in 
35 the Clip AV stream. The MPEG 2 system standard provides that the PTS has a wraparound period of 233/90000 sec 
(about 26.5 hours). 

[0291] By way of defining the Bridge-Clip AV stream, the Bridge-Clip AV stream must have a structure of the DVR 
MPEG 2 transport stream defined as described above. The Bridge-Clip AV stream must Include a discontinuous point 
of one arrival time base. The transport stream ahead and at back of the discontinuous point of the arrival time base 

40 must obey the encoding limitations and the DVR-STD as later explained. 

[0292] The present embodiment supports the video-audio seamless connection between Playltems being edited. 
Seamless connection between Playltems guarantees "continuous data supply" to the player/decoder and "seamless 
decoding processing". The "continuous data supply" is the capability of guaranteeing data supply to the decoder at a 
bitrate necessary to prevent buffer underflow. In order to enable data to be read out from the disc as data real-time 

45 properties are assured, data is to be stored in terms of a continuous-block of a sufficiently large size as a unit. 

[0293] The "seamless decoding processing" means the capability of a player in displaying audio video data recorded 
on the disc without producing pause or gap in the playback output of the decoder. 

[0294] The AV stream, referenced by the seamless connected Playltems, is explained. Whether or not the seamless 
display of a previous Playltem and the current Playltem is guaranteed may be verified from the connect!on_condition 
50 field defined in the current Playltem. There are two methods for seamless connection of Playltems, that is a method 
employing Bridge-Clip and a method not employing Bridge-Clip. 

[0295] Fig. 88 shows the relation between the previous Playltem and the current Playltem in case of employing 
Bridge-Clip. In Fig.88, the stream data, read out by the player, is shown shaded. In Fig.88, TS1 Is made up of shaded 
stream data of the Clip1 (Clip AV stream) and shaded stream data previous to RSPN_arrivaLtime_discontinuity. 
55 [0296] The shaded stream data of Clipl of TS1 is stream data from an address of a stream required for decoding 
the presentation unit corresponding to INJtem of the previous Playltem (shown as IN-timel in Fig.88) up to the source 
packet referenced by RSPN_exit__from_previous_Clip. The shaded stream data prior to 
RSPN_arrivaLtime_discontinuity of Bridge-Clip contained in TS1 is stream data as from the first source packet of 
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Bridge-Clip up to the source packet directly previous to the source packet referenced by 
RSPN_arrival_time_discontinurty. 

[0297] In Fig. 88, TS2 is made up of shaded stream data of Clip 2 (Clip AV stream) and shaded stream data subse- 
quent to RSPN_arrlvaLtlme_dlscontlnulty of Bridge-Clip, The shaded stream data as from the 

5 RSPN_arrivaLtime_discontlnu}ty of Bridge-Clip contained in TS2 stream data from the source packet referenced by 
RSPN_arrival_time_discontlnurty to the last source packet of Bridge-Clip. The shaded stream data of Clip2 of TS2 la 
stream data from the source packet referenced by RSPN_enter_to_current_Clip to the address of the stream required 
for decoding the presentation unit corresponding to OUT_time of current Playitem (shown by OUT_time2 in Fig.88). 
[0298] Fig.89 shows the relation between the previous Playitem and the current Playitem in case of not employing 

10 Bridge-Clip. In this case, the stream data read out by the player is shown shaded. In Fig.89,TS1 is made up of shaded 
stream data of the Clip1 (Clip AV stream). The shaded stream data of Clip1 of TS1 is data beginning at an address of 
a stream necessary in decoding a presentation unit corresponding to IN_time of the previous Playitem, shown at 
lN_ttme1 in Fjg.89 as far as the last source packet of Cllp1 . 
[0299] In Fig.89, TS2 Is shaded stream data of Cllp2 (Clip AV stream). 

fs [0300] The shaded stream data of Clip2 of TS2 is stream data beginning at a first source packet of Ciip2 as far as 
an address of the stream necessary for decoding the presentation unit corresponding to OUT_time of current Playitem 
(shown at OUT_tlme2 in Fig.89). 

[0301] In Figs.88 and 89, TS1 and T2 are continuous streams of the source packet. Next, the stream provisions of 
TS1 and TS2 and the connection conditions therebetween are scrutinized. First, encoding limitations for seamless 

20 connection are scrutinized. By way of limitations on the encoding structure of a transport stream, the number of pro- 
grams contained in TS1 and TS2 must be 1 . The number of video streams contained in TS1 and TS2 must be 1 . The 
number of audio streams contained in TS and TS2 must be 2 or less. The numbers of the audio streams contained in 
TS1 and TS2 must be equal to each other. It Is also possible for elementary streams or private streams other than 
those depicted above to be contained in TS1 and/or TS2. 

25 [0302] The limitations on the video bitstream are now explained. Fig. 90 shows atypical seamless connection indi- 
cated by a picture display sequence. In order for a video stream to be demonstrated seamlessly in the vicinity of a 
junction point, unneeded pictures displayed at back of OUT_time1 (OUT_tlme of Clip1 ) and ahead of IN_time2 (IN_tlme 
of Clip2) must be removed by a process of re-encoding the partial stream of the Clip in the vicinity of the junction point. 
[0303] Fig. 91 shows an embodiment of realizing seamless connection using BridgeSequence. The video stream of 

30 Bridge-Clip previous to RSPN_arrival_time_dlscontinuity is comprised of an encoded video stream up to a picture 
corresponding to OUT_time1 of Clip1 of Fig. 90. This video stream Is connected to the video stream of previous Clip1 
and Is re-encoded to form an elementary stream confomriing to the MPEG2 standard. 

[0304] The video stream of Bridge-Clip subsequent to RSPN_arrivaLtime_discontlnuity is made up of an encoded 
video stream subsequent to a picture corresponding to IN_tlme2 of Clip2 of Fig. 90. The decoding of this video stream 

35 can be started correctly for connecting the video stream to the next following Clip2 video stream. Re-encoding is made 
such that a sole continuous elementary stream conforming to M PEG 2 standard will be formed. For creating Bridge-Clip, 
several pictures in general need to be re-encoded, whilst other pictures can be copied from the original Clip. 
[0305] Fig. 92 shows an embodiment of realizing seamless connection without employing BridgeSequence in the 
embodiment shown In Fig. 90. The Cllp1 video stream Is comprised of an encoded video stream as far as the picture 

40 corresponding to OUT_time1 of Fig. 90 and Is re-encoded so as to give an elementary stream conforming to the MPEG2 
standard. In similar manner, the video stream of Clip2 is made up of encoded bitstreams subsequent to the picture 
associated with IN_tlme2 of Cllp2 of Fig. 90. These encoding bitstreams are already re-encoded to give a sole contin- 
uous elementary stream conforming to the MPEG2 standard. 

[0306] By way of explaining encoding limitations of the video stream, the frame rates of the video streams of TS1 

45 and TS2 must be equal to each other. The video stream of TS1 must be terminated at sequence_end_code. The video 
stream of TS2 must commence at Sequence header, GOP Header and with an l-picture. The video stream of TS2 
must commence at a closed GOP. 

[0307] The video presentation units defined In a bitstream (frame or field) must be continuous with a junction point 
in-between. No gap of the fields or frames are allowed to exist at junction points. In case of encoding employing 3-2 
50 pulldown, it may be necessary to rewrite "top_fleld_first" and "repeat_first_field" flags. Alternatively, local re-encoding 
may be made to prevent field gaps from being produced. 

[0308] By way of explaining encoding limitations on the audio bitstream, the audio sampling frequency of TS1 and 
that of TS2 must be equal to each other. The audio encoding method of TS1 and that of TS2 (for example, MPEG1 
layer 2, AC-3, SESF LPCM and AAC) must be equal to each other. 
55 [0309] By way of explaining encoding limitations on MPEG-2 transport stream, the last audio frame of the audio 
stream of TS1 must contain audio samples having a display timing equal to the display end time of the last display 
picture of TS1 . The first audio frame of the audio stream of TS2 must contain an audio sample having a display timing 
equal to the display start timing of the first display picture of TS2. 
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[0310] At a junction point, no gap may be allowed to exist in a sequence of the audio presentation units. As shown 
In Fig. 93, there may be an overlap defined by the length of the audio presentation unit less than two audio frame 
domains. The first packet transmitting an elementary stream of TS2 must be a video packet. The transport stream at 
the junction point must obey the DVR-STD which will be explained subsequently. 

[0311] By way of explaining limitations on the Clip and Bridge-Clip, no discontinuities in the arrivai time base are 
allowed to exist in TS1 or in TS2. 

[0312] The following limitations are applied only to the case of employing the Bridge-Clip. The Bridge-Clip AV stream 
has a sole discontinuous point in the arrival time base only at a junction point of the last source packet of TS 1 and the 
first source packet of TS2. The SPN_arrivaLtime_discontinuity defined in Cliplnfo() represents an address of the dis- 
continuous point, which must represent the address referencing the first source packet of TS2. 
[0313] The source packet referenced by RSPN_exit_from_previous_Clip defined in BridgeSequencelnfo() may be 
any source packet in Clip1 . It is unnecessary for this source packet to be a boundary of the Aligned unit. The source 
packet referenced by RSPN_enter__to_current_Clip defined in BridgeSequencelnfoQ may be any source packet in 
Clip2. It is unnecessary for this source packet to be a boundary of the Aligned unit. 

[0314] By way of explaining limitations on Playltem, the OUT_time of the previous Play Item (OUT_time 1 shown in 
Fig. 89) must represent the display end time of the last video presentation unit of TS1 . The IN_time of the current 
PlayTime (IN_time2 shown in Fig. 88 and 89) must represent the display start time of the first presentation unit of TS2. 
[0315] By way of explaining the limitations on the data allocation in case of employing Bridge-Clip by referring to Fig. 
94, the seamless connection must be made to guarantee continuous data supply by the file system. This must be 
realized by arranging the Bridge-Clip AV stream, connecting to Clip1 (Clip AV stream file) and Clip2 (Clip AV stream 
file), such as to satisfy data allocation prescriptions. 

[0316] RSPN_exit_from_previous_Clip must be selected so that the stream portion of Clip1 (Clip AV stream file) 
previous to RSPN_exit_from_previous_Clip will be arranged In a continuous area not less than half fragment. The data 
length of the Bridge-Clip AV stream must be selected so that the data will be arranged in the continuous area not less 
than half fragment. RSPN_enter_to_current_Cllp must be selected so that the stream portion of Clip2 (Clip AV stream 
file) subsequent to RSPN_enter_to_current_Clip will be arranged In a continuous area not less than half fragment. 
[0317] By way of explaining data allocation limitations in case of seamless connection not employing Bridge-Clip, 
by referring to Fig.95, the seamless connection must be made so as to guarantee continuous data supply by the file 
system. This must be realized by arranging the last portion of the Clipl (Clip AV stream file) and the first portion of the 
Clip2 (Clip AV stream file) so that the provisions on data allocation will be met. 

[0318] The last stream portion of Clipl (Clip AV stream file) must be arranged in a continuous area not less than one 
half fragment. The first stream portion of Clip2 (Clip AV stream file) must be arranged in a continuous area not less 
than one half fragment. 

[0319] In a case where digital AV signals each having a predetermined bit rate are fragmented and recorded on a 

disc, to assure that the recorded digital AV signals can be read out from the recording medium 1 00 in the predetermined 
bit rate, the size of one continuous recording area must satisfy the following condition: 

S*8 / (S*8/Rud + Ts) >= Rmax 

where 

S: minimum size of one continuous recording area [Byte] 

Ts: access time of full stroke from one recording area to next recording area [second] 

Rud: bit rate for reading out from recording medium [bit/second] 
Rmax: bit rate of AV stream [bit/second]. 

[0320] That is, the data must be arranged so that S byte or more data in the AV stream may be recorded continuously 
on the disc. 

[0321] The data must be arranged so that the size of the half fragment may be S byte or more. 
[0322] Next, DVR-STD is explained. This DVR-STD is a conceptual model for modeling the decoding processing in 
the generation and verification of the DVR MPEG 2 transport stream. The DVR-STD is also a conceptual model for 
modeling the decoding processing in the generation and verification of the AV stream referenced by two Playltems 
seamlessly connected to each other as described above. 

[0323] Fig. 96 shows a DVR-STD model. The model shown in Fig. 96 Includes, as a constituent element, a DVR 
MPEG 2 transport stream player model. The notation of n, Tbn, Mbn, Ebn, Tbsys, Bsys, Rxn, Rbxn, Rxsys, Dn, Dsys, 
On and P9(k) is the same as that defined in T-STD of ISO/I EC 1 381 8-1 , wherein n is an index number of an elementary 
stream and TBn is a transport buffer of the elementary stream n. 
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[0324] MBn is a multiplexing buffer of the elementary stream n and exists only for the video stream. EBn is an 
elementary stream buffer of the elementary stream n and is present only for the video stream. TBsys is a main buffer 
In a system target decoder for the system Information for a program being decoded. Rxn Is a transmission rate with 
which data is removed from TBn. Rbxn Is a transmission rate with which the PES packet payload Is removed from MBn 
and Is present only for a video stream. 

[0325] Rxsys is a transmission rate with which data is removed from TBsys. Dn is a decoder of the elementary stream 
n. Dsys is a decoder pertinent to the system Infomnation of a program being decoded. On Is a re-ordering buffer of the 
video stream n. Pn(k) is a number k presentation unit of the elementary stream. 

[0326] The decoding process for DVR-STD Is explained. During the time a sole DVR MPEG 2 transport stream Is 
being reproduced, the timing of inputting the transport packet to TB1 , TBn or TBsys is determined by arrival_time_stamp 
of the source packet. The prescriptions for the buffering operation of TB1 , MB1 , EB1 , TBn Bn, TBsys and Bsys are the 
same as those of the T-STD provided for in ISO/IEC 13818-1 , while the prescriptions for the deciding and display 
operations are also the same as the T-STD provided for In ISO/IEC 1381 8-1 . 

[0327] The decoding process during the time the seamlessly connected PlayLists are being reproduced is now ex- 
plained. Here, the reproduction of two AV streams referenced by the seamlessly connected Play Items is explained. In 
the following explanation, the reproduction of TBI and TS2, shown for example in Fig. 88, is explained. TS1 and TS2 
are a previous stream and a current stream, respectively 

[0328] Fig. 97 shows a timing chart for Inputting, decoding and display of transport packets when transferring from 
a given AV stream (TS1 ) to the next AV stream seamlessly connected thereto CTS2). During transfer from a preset AV 
stream (TS1) to the next AV stream seamlessly connected thereto (TS2), the time axis of the arrival time base of TS2 
is not the same as the time axis of the arrival time base of TS1 (indicated by ATC1 in Fig. 97). 

[0329] Moreover, the time axis of the system time base of TS2 (indicated by ATC1 in Fig.97) is not the same as the 
time axis of the system time base of TS1 (indicated by STC1 In Flg.97). The video display is required to be continuous 
seamlessly, however, there may be overlap in the display tine of the presentation units. 

[0330] The input timing to DVR-STD is explained. During the time until time T1 , that is until the inputting of the last 
video packet to the TBI of DVR-STD. the input timing to the buffers of TBI , TBn or TBsys of DVR-STD is detemiined 
by arrivaLtime_stamp of the arrival time base of TS1 . 

[0331] The remaining packets of TS1 must be input to buffers of TBn or to TBsys of DVR-STD at a bitrate of 
TS_recordlng_rate (TS1). The TS_recordjng_rate (TS1) is the value of TS_recording_rate defined In Cliplnfo() corre- 
sponding to Clip1 . The time the last byte of TS1 is Input to the buffer is the time T2. So, during the time between time 
T1 and time T2, arrivaLtlme_stamp of the source packet is discounted. 

[0332] If N1 is the number of bytes of the transport packet of TS1 next following the last video packet of TS1 , the 
time DTI from time T1 until time T2 Is the time necessary for N1 bytes to be Input completely at a bitrate of 
TS_recording_rate (TS1), and is calculated in accordance with the following equation: 

DTI = T2 - T1 = N1/TS_recording_rate. 

[0333] During the time from time T1 until time T2 (TS1 ), both the values of RXn and RXsys are changed to the value 
of TS-recording_rate (TS1). Except this rule, the buffering operation Is the same as that of T-STD. 
[0334] At time T2, the arrival time clock counter is reset to the value of arrivaLtime_stamp of the first source packet 
of TS2. The input timing to the buffer of TBI , TBn or TBsys of DVR-STD is determined by arrivaLtime_stamp of the 
source packet of TB2. Both RXn and RXsys are changed to values defined in T-STD. 

[0335] By way of explaining additional audio buffering and system data buffering, the audio decoder and the system 
decoder need to have an additional buffering amount (data amount equivalent to one second) in addition to the buffer 
amount defined in T-STD in order to allow input data of a domain from time T1 to time T2. 

[0336] By way of explaining the video presentation timing, the display on the video presentation unit must be con- 
tinuous, that is devoid of gaps, through junction point. It is noted that STC1 Is the time axis of the system time base of 
TS1 (indicated as STC1 in Fig. 9), while STC2 is the time axis of the system time base of TS2 (shown at STC2 in Fig. 
97; correctly, STC2 begins at time the first PGR of TS2 has been input to the T-STD). 

[0337] The offset between STC1 and STC2 is determined as follows: the PTS1 end is the PTSonSTCI corresponding 
to the last video presentation unit of TS2. PTS2start is PTS on STC2 corresponding to the first video presentation unit 
of TS2 and Tpp is the display time period of the last video presentation unit of TS1 , the offset STC_delta between two 
system time bases is calculated in accordance with the following equation: 

STC_delta = PTSIend + Tpp - PTS2start. 
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[0338] By way of explanation of the audio presentation timing, there may be overlap in the display timing of the audio 
presentation unit, with the overlap being less than 0 to 2 audio frames (see "audio overlap" shown in Fig.97). The 
indication as to which of audio samples is to be selected and re-synchronization of the display of the audio presentation 
unit to the corrected time base at back of the junction point are set on the player 

[0339] By way of explaining the system time clock of DVR-STD, the last audio presentation unit of TS1 is displayed 
at time T5. The system time clock may be overlapped between time T2 and time T5. During this time domain, the 
DVR-STD switches the system time clocks between the value of the old time base (STC1) and the value of the new 
time base (STC2). The value of STC2 may be calculated in accordance with the following equation: 

STC2 = STC1- STC.delta. 

[0340] The buffering continuity is explained. STC11 vldeo_end is the value of STC on the system time base STC2 
when the first byte of the first video packet reaches TB1 of DVR-STD. STC22vldeo_start is the value of STC on the 
system time base STC2 when the first byte of the first video packet reaches TB1 of DVR-STD. STC21 video_end is 
the value of STC11 video.end calculated as the value on STC2 of the system time base STC2. STC21 video_end is 
calculated in accordance with the following equation: 

STC21 video_end = STC11 video_end - STC_delta. 

[0341] In order to obey DVR-STD, the following two conditions must be met: First, the arrival timing of the first video 
packet of TS2 at TB1 must satisfy the following inequality: 

STC22video_start > STC21 video.end + AT1 . 

[0342] If it is necessary to re-encode and/or multiplex the partial stream of Clip1 and/or Clip2, in such a manner that 
the above inequality will be satisfied, this re-encoding or multiplexing is performed as appropriate. 
[0343] Second, the inputting of the video packet from TS1 followed by the inputting of the video packet from TS2 on 
the time axis of the system time base, mapped from STC1 and STC2 on the same time axis, must not overflow or 
underflow the video buffer. 

[0344] If the above syntax, data structure and the rules are used as basis, the contents of data recorded on the 
recording medium or the reproduction information can be managed properly to enable the user to confirm the contents 
of data recorded on the recording medium at the time of reproduction or to reproduce desired data extremely readily. 
[0345] In the above-described embodiment, the MPEG 2 transport stream is taken as an example of the multiplexed 
stream. This, however, is merely exemplary, such that the IVIPEG 2 program stream DSS or the transport stream used 
in the DirecTV Service (trade mark) of USA may also be used as the multiplexed stream. 

[0346] Fig.98 shows a modification of BridgeSequencelnfo(). The difference from the BridgeSequencelnfoQ of Fig. 
38 is that it contains only Bridge_Clip_lnfonnation_file_name. 

[0347] Fig. 99 illustrates Bridge_Gnp when two Playltems are seamlessly connected in case of using the syntax of 
BridgeSequencelnfoO of Fig.98. RSPN_exit_from_previous_Clip is the source packet number of the source packet on 
the Clip AV stream referenced by the previous Playltem. Next to this source packet Is connected the first source packet 
of the Bridge_Clip AV stream file. 

[0348] RSPN_enter„to_current_Cllp Is the number of the source packet on the Clip AV stream referenced by the 
current Playltem. Ahead of this source packet is connected the last source packet of the Bridge-Clip AV stream file 
referenced by the current Playltem. In the Bridge-Clip AV stream, shown in Fig. 99, SPN_ATC_start indicates the source 
packet number of the source packet in the Bridge-Clip AV stream file at which commences the time axis of new an^lval 
time base. 

[0349] The Bridge-Clip AV stream file has a sole arrival time base discontinuous point. The second SPN_ATC_start 
in the drawings has the same meaning as that of the RSPN_arrival_time_discontinuity in Fig.37. 
[0350] If the syntax of BridgeSequencelnfoQ of Flg.98 Is used, RSPN_exit_from_previous_Clip and 
RSPN_enter_to_current_Clip are stored In the Clip Information file corresponding to the Bridge-Clip AV stream file. 
SPN_ATC_start is also stored in the Clip Information file. 

[0351] Fig. 100 shows the syntax of the Clip Information file when the BhdgeSequencelnfo is of the syntax of Fig.98. 
Sequencelnfo_start_address indicates the leading address of Sequencelnfo(), in terms of the number of relative bytes 
from the leading byte of the Clip Infomiation file as a unit. The number of relative bytes is counted from 0. 
[0352] Fig. 101 shows the syntax of Cliplnfo() of the Clip Information file of Fig. 100. Clip_stream_type indicates wheth- 



29 



EP1 198 133 A1 



er the AV stream file of the Clip is the Clip AV stream file or the Bridge-Clip AV stream file. If the Cllp_stream_type 
indicates the Bridge-Clip AV stream file, the next syntax field follows. 

[0353] Previous_Clip_lnformation_flle_name indicates the Clip Information file name connected ahead of the 
Bridge-Clip AV stream file. RSPN_exlt_from_previous_Clip is the source packet number of the source packet on the 
5 Clip AV stream file indicated by previous_Clip_lnformation_file_name. Next to this source packet is connected the first 
source packet of the Bridge-Clip AV stream file. This source packet number is counted as from the first source packet 
of the Clip AV stream file, with 0 as an initial value. 

[0354] Current_Clip_lnfomiation_file_name indicates the Clip Information file name of the Clip connected at back of 
the Bridge-Clip AV streeim file. RSPN_enter_to_current_Clip is the source packet number of the source packet on the 
10 Clip AV stream file indicated by the current_Cllp_lnformation_flle_name. Ahead of this source packet is connected the 
last source packet of the Bridge-Clip AV stream file. This source packet number is the is counted as from the first 
source packet of the Clip with the AV stream file with 0 as an initial value. 

[0355] Fig. 102 Indicates the syntax of the SequencelnfoQ of the Clip Infomriatlon file of Fig. 100. 
Num_of_ATC_sequence indicates the number of the ATC_sequence in the AV stream file. ATC_sequence is a source 
15 packet sequence not containing discontinuous points of the arrival time base. In the case of Bridge-Clip, this value is 2. 
[0356] SPN_ATC_start[atc_id] indicates an address at which commences the arrival time base indicated by atc_id 
on the AV stream file. SPN_ATC_start[atc__id] is of a size based on the source packet number as unit and is counted 
as from the first source packet of the AV stream file with 0 as an initial value. 

[0357] Figs.1 03A and 1 03B illustrate database change in case stream data of the Clip AV stream file referenced by 
20 Bridge-Sequence is partially erased. It is assumed that, as indicated by "Before Editing" in Fig.lOSA, Clipl and Clip2 
are interconnected by Bridge-Clip, with RSPN_exit_from_previous_Clip = X and RSPN„enter_to_current_Clip = Y 
[0358] It is assumed that a stream data portion of Z1 source packets of Clipl , shown shaded, and a stream data 
portion of Z1 source packets of Clip2, likewise shown shaded, are to be erased. As a result, 
RSPN_exit_from_previous_Clip becomes equal to X- Z1 and RSPN_enter_to_current_Clip becomes equal to Y-Z2, 
25 by way of value changing, as indicated by "After Editing" in Fig.lOSB. 

[0359] By changing the syntax of the database pertinent to BridgeSequence as shown in Figs. 98 and 1 01 , the infor- 
mation pertinent to the source packet number indicating a data address in the AV stream (a field commencing from 
RSPN in the database syntax) is depleted from the layer of the PlayList, such that the totality of the information on the 
source packet number is stated in the Clip layer. 
30 [0360] In this case, if it is necessary to change the value of the data address in the AV stream, as when data of the 
AV stream file has been partially erased, it Is only sufficient if measly the Clip Information file is supervised as data, 
thus advantageously facilitating database management. 

[0361] Fig. 1 04 is a flowchart illustrating the preparation of the RealPlayList. Reference is had to the block diagram 
of Fig.1 showing the recording and/or reproducing apparatus 1 . At step SI 0, a controller 23 records a Clip AV stream. 
35 At step S11 , the controller 23 forms PlayListQ made up of Playltems covering the totality of the possible playback range 
of the above Clip. If there is STC discontinuous point in the Clip, and PlayList() is made up of two or more Playltems, 
the connection_condition between the Playltems is also determined. 

[0362] At step S12, the controller 23 forms UIApplnfoPlayList(). At step S13, the controller 23 fonns PlayListMark. 
At step 1 4, the controller 23 forms MakersPrivateData. At step SI 5, the controller 23 records a Real PlayList file. In 

40 this manner, one Real PlayList file Is created each time a Clip AV stream file is newly recorded. 

[0363] Fig. 105 is a flowchart for illustrating the formulation of a Virtual PlayList having a bridge sequence. At step 
S20, reproduction of one Real PlayList recorded on the disc is specified through a user interface. From the reproduction 
range of the Real PlayList, the reproduction domain specified by IN and OUT points is specified through user interface. 
[0364] At step S21 , the controller 23 verifies whether or not the operation of specifying the reproduction range by 

45 the user has been finished in its entirety. If it is verified that the specifying operation has been finished, the controller 
23 proceeds to step 822 and, if otherwise, the controller 23 reverts to step 820 to repeat the subsequent processing. 
[0365] At step 822, the user determines the connection condition between two continuously reproduced Playltems 
(connection_condition), through user interface, or the controller 23 determines the connection condition. At step S23, 
the controller 23 forms a bridge sequence for the seamlessly connected Playltems. At step 854, tghe controller 23 

50 forms and records the Virtual PlayList file. 

[0366] Fig. 106 is a flowchart for illustrating the detailed processing at step 823. At step 831, the controller 23 re- 
encodes and re-multiplexes an AV stream on the OUT point side of the Playltem displayed on the temporally forward 
side. At step 832, the controller 23 re-encodes and re-multiplexes the AV stream on the IN point side of the Playltem 
represented next to the Playltem. 

55 [0367] At step 833, the controller 23 determines the value of the RSPN_exit_from_previous_Clip such as to satisfy 
the data allocation condition for continuous data supply. That is, R8PN_exit_from_previous_Clip must be selected so 
that the stream portion of the Clip AV stream file previous to RSPN_exlt_from_previous_Clip will be recorded in a 
continuous area not less than the aforementioned half fragment on the recording medium (see Figs.91 and 94). 
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[0368] At step S34, the controller 23 determines the value of RSPN_enter_to_current_Clip such as to satisfy the 
data allocation condition for continuous data supply. That is, RSPN_enter_to_current_Cllp must be selected so that 
the stream portion of the AV stream file subsequent to RSPN_enter_to_current_Clip will be arrayed in a continuous 
area not less than the aforementioned one fragment on the recording medium (see Figs.91 and 94). 
5 [0369] At step S35, the controller 23 forms the Bridge-Clip AV stream file such as to satisfy the data allocation con- 
dition for continuous data supply. That is, if the volume of data prepared in the processing of steps S31 and S32 is less 
than the size of the aforementioned one half fragment, data is copied from the original Clip to prepare Bridge-Clip (see 
Figs.91 and 94). 

[0370] Although the processing operations of steps S33 to S35 is explained chronologically, these processing oper- 
10 ations may also be carried out non-sequentially or simultaneously since these processing operations are relevant 
reciprocally. 

[0371] At step S36, the controller 23 forms a bridge sequence database. At step S37, the controller 23 records a 
Bridge-Clip AV stream file and its Clip information file. In this manner, one or more Playltem is selected by the user 
from the reproduction range of Real PlayList recorded on the disc. A bridge sequence for enabling seamless connection 
15 of two Playltems is formed and a set of one or more Playltems, grouped together, is recorded as one Virtual PlayList. 
[0372] Fig. 107 is a flowchart for illustrating the reproduction of PlayList. At step S41 , the controller 23 acquires Info, 
dvr, a Clip Information file, a PlayList file and the thumbnail information to prepare a GUI picture a list of PlayLists 
recorded on the disc to display the so formed picture on the GUI through user interface. 

[0373] At step S42, the controller 23 presents the information illustrating the PlayList on the GUI picture based on 
20 UlApplnfoPlayListO of each PlayList. At step S43, the user instructs reproduction of one PlayList from the GUI picture 

through a user interface. At step S44, the controller 23 acquires, from the PTS of IN_time and STC-sequecne-id of the 

current Playltem, a source packet having an entry point temporally previous and closest to (N_time. 

[0374]- At step S45, the controller 23 reads out data of the AV stream from the source packet number having the 

above entry point to send the so read out data to decoder. If, at step S46, there is any Playltem temporally previous 
25 to the current Playltem, the controller 23 performs the processing of interconnecting the previous Playltem and the 

current Playltem in accordance with connectlon_condltion. If the Playltems are interconnected seamlessly, the AV 

stream is decoded based on the DVR-STD decoding method. 

[0375] At step S47, the controller 23 commands the AV decoder 27 to start the display as from the picture of the 
PTS of IN^time. At step S48, the controller 23 commands the AV decoder 27 to continue decoding the AV stream. At 

30 step S49, the controller 23 verifies whether or not the picture currently displayed is the picture of PTS of OUT_time. If 
it is verified that the picture currently displayed is not the picture of PTS of OUT_time, the controller 23 proceeds to 
step S50 to display the picture, after which the controller 23 reverts to step S48 to repeat the subsequent processing. 
[0376] If it is verified at step S49 that the picture currently displayed is the picture of PTS of OUT_tlme, the controller 
23 proceeds to step S51 where the controller 23 verifies whether or not the current Playltem is the last one In the 

35 PlayList. If it Is verified that the current Playltem is not the last one, the controller 23 reverts to step S44 to repeat the 
subsequent processing. If It is verified that the current Playltem is the last one, reproduction of the PlayList is finished. 
[0377] In this manner, the one PlayList file, specified to be reproduced by the user, Is reproduced. 
[0378] Based on the above-described syntax, data structure and rule, as described above, the contents of data 
recorded on the recording medium, the playback infonnation and so forth can be properly managed to enable the user 

40 to confirm the contents of data recorded on the recording medium properly to reproduce the desired data extremely 
readily. 

[0379] The above-described sequence of operations may be executed not only by hardware but also by software. If 
the sequence of operations is to be executed by software, it is installed from a recording medium to a computer in the 
dedicated hardware of which is installed the program fonning the software or to e.g., a general-purpose personal 

45 computer capable of executing various functions based on a variety of programs installed therein. 

[0380] Fig. 1 08 shows an illustrative inner structure of a general-purpose computer. A CPU (central processing unit) 
201 of the personal computer executes a variety of processing operations in accordance with a program stored in a 
ROM (read-only memory) 202. In a RAM (random-access memory) 203, there are suitably stored data or programs 
necessary for the CPU 201 to execute various processing operations. To an input/output interface 205 is connected 

50 an input unit 206 formed by a keyboard, a mouse and so forth to output signals input to the input unit 206 to the CPU 
201 . To the input/output interface 205, there is also connected an output unit 207 made up of a display, a loudspeaker 
and so forth. 

[0381] To the input/output interface 205, there are also connected a recording unit 208 made up e.g., of a hard disc 
and a communication unit 209 adapted for exchanging data with outer equipment over a network, such as Internet. A 
55 drive 210 is used for reading out or writing data on or from a recording medium, such as a magnetic disc 221, an optical 
disc 222, a magneto-optical disc 223 or a semiconductor memory 224. 

[0382] The recording medium is constituted not only by a package medium distributed for furnishing the program to 
the user, in addition to a computer, such as a magnetic disc 221 carrying the program thereon, Inclusive of a floppy 
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disc, an optical disc 222, inclusive of a CD-ROM (Compact Disc-Read-Only memory) or a DVD (Digital Versatile Disc), 
a magneto-optical disc 223, inclusive of a Mini-Disc, or a semiconductor memory 224, but also by a hard disc, inclusive 
of a ROM 202 carrying a program and a memory 208, furnished to the user as it is built-in in a computer, as shown in 
Fig.108. 

[0383] In the present specification, the steps of the program furnished by the medium include not only the chrono- 
logical processing in accordance with the sequence Indicated, but also the processing perfonned not chronologically 
but in parallel or separately. 

[0384] Additionally, in the specification, the system means an entire apparatus comprised of plural component de- 
vices. 

Industrial Applicability 

[0385] In the infomnation processing method and apparatus, and the program, according to the present invention, if 
the it is commanded to perform reproduction continuously from the first AV stream to the second AV stream, there is 
generated a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream and which is reproduced when reproduction is switched from the first AV stream to the second AV stream, while 
there is generated, as the information pertinent to the third AV stream, the address information made up of the infor- 
mation on an address of a source packet of the first AV stream at a timing of switching of reproduction from the first 
AV stream to the third AV stream, and of the information on the address of a source packet of the second AV stream 
at a timing of switching of reproduction from the third AV stream to the second AV stream. So, reproduction may be 
achieved such as to maintain continuity in separately recorded AV streams. 

[0386] In the information processing method and apparatus, and the program, according to the present invention, a 
first AV stream, a second AV-stream or a third AV stream is read out from a recording medium, the address information 
made up of the infomnation on an address of a source packet of the first AV stream at a timing of switching of reproduction 
from the first AV stream to the third AV stream, and the information on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, is read out from 
the recording medium as the information pertinent to the third AV stream, and reproduction is switched from the first 
AV stream to the third AV stream and from the third AV stream to the second AV stream, as reproduction proceeds, 
based on the read-out information pertinent to the third AV stream. So, reproduction may be achieved such as to 
maintain continuity in separately recorded AV streams. 



Claims 

1. An information processing apparatus comprising: 

generating means for generating, in case continuous reproduction from a first AV stream to a second AV stream 
is commanded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of 
said second AV stream, said third AV stream being reproduced when reproduction is switched from said first 
AV stream to said second AV stream, and the address information, as the information pertinent to said third" 
AV stream, said address infomnation being made up of the information on an address of a source packet of 
said first AV stream at a timing of switching of reproduction from said first AV stream to said third AV stream, 
and of the information on the address of a source packet of said second AV stream at a timing of switching of 
reproduction from said third AV stream to said second AV stream; and 

recording means for recording said third AV stream and said address infomnation, as generated by said gen- 
erating means. 

2. The information processing apparatus according to claim 1 wherein an arrival time stamp of the source packet of 
said first AV stream included in said address information generated by said generating means, and an arrival time 
stamp of a source- packet located at a leading end of said third AV stream, are continuous to each other, and 
wherein an arrival time stamp of the source packet of said second AV stream included in said address information 
generated by said generating means and an an'ival time stamp of a source packet located at a trailing end of said 
third AV stream are continuous to each other, 

3. The information processing apparatus according to claim 2 wherein a sole discontinuous point exists in the arrival 
time stamp of the source packet in said third AV stream. 

4. The information processing apparatus according to claim 2 wherein said address is detemnined so that a data 
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portion of the AV stream previous to a source packet specified by the Information on the address of the source 
packet of said first AV stream contained in said address information generated by said generating means will be 
located In a continuous area of not less than a preset size on a recording medium. 

The Information processing apparatus according to claim 2 wherein said address is determined so that a data 
portion of the AV stream subsequent to a source packet specified by the information on the address of the source 
packet of said second AV stream contained in- said address information generated by said generating means will 
be located in a continuous area of not less than a preset size on a recording medium. 

The information processing apparatus according to claim 2 wherein said third AV stream is generated so that said 
third AV stream will be located in a continuous area of not less than a preset size on said recording medium. 

An information generating method comprising: 

a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is com- 
manded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of said 
second AV stream, said third AV stream being reproduced when reproduction is switched from said first AV 
stream to said second AV stream, and 

a step of generating the address information, as the Information pertinent to said third AV stream, said address 
information being made up of the information on an address of a source packet of said first AV stream at a 
timing of switching of reproduction from said first AV stream to said third AV stream, and of the information on 
the address of a source packet of said second AV stream at a timing of switching of reproduction from said 
third AV stream to said second AV stream. 

A recording medium having recorded thereon a computer-readable program, said program comprising: 

a step of generating, In case continuous reproduction from a first AV stream to a second AV stream is com- 
manded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of said 
second AV stream, said third AV stream being reproduced when reproduction Is switched from said first AV 
stream to said second AV stream, and 

a step of generating the address Information, as the information pertinent to said third AV stream, said address 
information being made up of the information on an address of a source packet of said first AV stream at a 
timing of switching of reproduction from said first AV stream to said third AV stream, and of the Information on 
the address of a source packet of said second AV stream at a timing of switching of reproduction from said 
third AV stream to said second AV stream. 

A program for having a computer execute a program, said program comprising: 

a step of generating, In case continuous reproduction from a first AV stream to a second AV stream is com- 
manded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of said 
second AV stream, said third AV stream being reproduced when reproduction is switched from said first AV 
stream to said second AV stream, and 

a step of generating the address information, as the Information pertinent to said third AV stream, said address 
Information being made up of the information on an address of a source packet of said first AV stream at a 
timing of switching of reproduction from said first AV stream to said third AV stream, and of the information on 
the address of a source packet of said second AV stream at a timing of switching of reproduction from said 
third AV stream to said second AV stream. 

An information processing apparatus comprising: 

first readout means for reading out a first AV stream, a second AV stream or a third AV stream from a recording 
medium; 

second readout means for reading out, as the infomnation pertinent to said third AV stream, the Information 
on an address of a source packet of said first AV stream at a timing of switching of reproduction from said first 
AV stream to said third AV stream, and of the information on the address of a source packet of said second 
AV stream at a timing of switching of reproduction from said third AV stream to said second AV stream; and 
reproducing means for performing reproduction as reproduction Is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
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based on the Information pertinent to said third AV stream read out by said second readout means. 

11. An information processing method comprising: 

a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium; 

a second readout controlling step of reading out, as the infomnation pertinent to said third AV stream, the 
information on an address of a source packet of said first AV stream at a timing of switching of reproduction 
from said first AV stream to said third AV stream, and of the information on the address of a source packet of 
said second AV stream at a timing of- switching of reproduction from said third AV stream to said second AV 
stream; and 

a reproducing step of perfonnlng reproduction as reproduction Is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
based on the information pertinent to said third AV stream read out by said second readout means. 

12. A recording medium having recorded thereon a computer-readable program, said program comprising: 

a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium; 

a second readout controlling step of reading out, as the Information pertinent to said third AV stream, the 
Information on an address of a source packet of said first AV stream at a timing of switching of reproduction 
. from said first AV stream to said third AV stream, and of the information on the address of a source packet of 
said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 
stream; and 

a reproducing step of perfomiing reproduction as reproduction is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
based on the information pertinent to said third AV stream read out by said second readout means. 

13. A program for having a computer execute a program, said program comprising: 

a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium; 

a second readout controlling step of reading out, as the Infonnation pertinent to said third AV stream, the 
Information on an address of a source packet of said first AV stream at a timing of switching of i^eproductlon 
from said first AV stream to said third AV stream, and of the information on the address of a source packet of 
said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 
stream; and 

a reproducing step of perfomiing reproduction as reproduction Is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
based on the information pertinent to said third AV stream read out by said second readout means. 

14. A recording medium having recorded thereon the address information comprising, in case continuous reproduction 
from a first AV stream to a second AV stream is commanded, a third AV stream made up of a preset portion of 
said first AV stream and a preset portion of said second AV stream, said third AV stream being reproduced when 
reproduction is switched from said first AV stream to said second AV stream, and the address information, as the 
information pertinent to said third AV stream, said address infomnation being. made up of the information on an 
address of a source packet of said first AV stream at a timing of switching of reproduction from said first AV stream 
to said third AV stream, and of the Information on the address of a source packet of said second AV stream at a 
timing of switching of reproduction from said third AV stream to said second AV stream. 



34 



EP1 198133 A1 




35 



EP1 198 133 A1 



Volume Information 



Playlist 



Playltem Playltem Playltera 



PlayDst — 



Time Stamp 



Clip Information 



Clip AV stream 




Clip • - cup ' 



FIG.2 



36 



EP1 198 133 A1 



IN poihrr/ 





OUT \\ 
POINT: v> 

IN ^ in' 



^OUT 
'•.POINT 



„ IN POINT 

Time Stamp 



our 

,POINT 




Clip Information 



Clip AV stream 



• 

Clip- ' * Clip ' Clip ' 



FiG.3 



37 



EP1 198 133 A1 

• 



Real PlayList 




Real Playlist 


K — d 




k 




^ 




1 i 




• 




1 Clip 1 




Clip 





FIG.4A 



DIVISION POINT 



Real PlayUst 



CUp 



Real 1 


Real 


PlayList 1 


Playlist 



Clip 



FiG.4B 



COUPLING 



Real 
Playlistl 






FIG.4C 



38 



EP 1 198 133 A1 



Real PlayUst 




. BOTH Real PlayUst 
CZ) AND Clip ARE 
^ DELETED 



FIG.5A 




DELETED 



Real Playlist 



Playltem 



Clip 



Real PlayUst 



Playltem 



I 




DELETED 



FIG.5B 





Real PlayList 



DELETED 



DELETED 



Clip 



FIG.5C 



1 



39 



EP 1 198 133 A1 



FIG.6A 



FIG.6B 



IN 
POINT 1 



OUT 
POINT 1 

_iL_. 



IN 
POINT 2 



OUT 
POINT 2 



Real PlayListl 



Real PIayUst2 



Clipl 



1 ;': 



0 



aip2 



IN 

POINT 1.. 




^Playltem ■ OUT 
^ POINT 1 



IN 
POINT 2 



OUT 
POINT 2 



Playltera 



Real PlayUstl 




1 1 TV 




; I <^ 




Clipl 1 



Real PlayList2 




40 



EP 1 198 133 A1 



•• Virtual Playlist 

Playltem 
(MAIN PATH) ^ . 

SubPlayltem 
. (SUB-PATH) . 



-< »- 



IN 

n POINTl 



OUT 
POINTl 




IN 
POINT 2 



OUT 
POINT 2 



Real Playlist2 



Clipl 

(MAIN AV STREAM) 



Clip2 

(SUPPLEMENTARY 
AUDIO STREAM) 



FIG.7 



41 



V 



EP 1 198 133 A1 



REPLAY SEQUENCE 



Real Playlistl 



Virtual PlayListl 



Real PIayList2 



Real PlayUst2 



Virtual PlayListl 



Real PlayListl 



FIG.8 



42 



EP1 198 133 A1 



PlayUst 



Playlist 

RESUMING 
BOOKMARK POINT 



CM 



Clip 



CM 



PlayList 



SCgNE ^ 




RESUMING 
POINT 

Lj 



FIG.9 



43 



EP 1 198 133 A1 



VOLUME 



PERSONAL 
COMPUTER 
(PC) 



DEGITAL 
STILL 
CAMERA(DSC) 



IN-VOLUME 
IMAGE 




MENU THUMBNAIL 



FIG.10 



PLAY LIST 



Playlist 



PLAY LIST MARK 

A 




1 



1 



i 



T 



I 



I 



] 



I 



MENU THUMBNAIL 



MARK THUMBNAIL 



FIG.11 



44 



EP 1 198 133 A1 





Clip [ 



1 



I 



CLIP MARK 

A 



1 



1 



1 



MARK THUMBNAIL 



FIG. 12 



VOLUME 
THUMBNAIL 



PlayDst 



CUp 




MENU THUMBNAIL FILE 
/ 



CD 



J w 



CD 



CD 






THUMBNAIL 
PICTURE 



MARK 
THUMBNAIL 
PICTURE 



FIG.13 



45 



EP 1 .198 133 A1 




info.dvr 



menu.thmb 



mark.thmb 



PIAYUST 



h CUPINF 




01001. rpls 



02002.Fpls 



99999.rpls 



OlOOO.clpi 



O2000.clpi 



OSOOO.clpi 



M2TS 






010O0.m2ts 






02000.m2ts 




,1 


03000,m2ts 



FIG.14 



46 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


info.dvr { 






TableOfPlayLists_Start_address 


32 


uimsbf 


MakersPrivateData_Start_address 


32 


uimsbf 


reserved 


192 


bslbf 


DVRVolumeO 






for (i-0;i<Nl;i-H-){ 






padding_word 


16 


bslbf 


) 






TableOfPlayListsQ 






for (i=0;i<N2;i++) { 






padding_word 


16 


. bslbf 


} 






MakersPrlvateDataO 






} 







FIG.15 



47 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


DVRVolumeOl 






version_nuniber 


8*4 


bslbf 


length 


32 


uimsbf 


Resume Vol umeQ 






UIAppInfoVolumeO 






} 







FIG.16 



48 



EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


ResumeVolume 0 ( 






reserved 


15 


bslbf 


valid_flag 


1 


bslbf 


resume.PlayList.name 


8*10 


bslbf 


) 







FIG.17 



49 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


UIAppInfo Volume 0 ( 






€haracter_set 


8 


bslbf 


name.Iength 


8 


uimsbf 


Volume_naine 


8*256 


bslbf 


reserved 


15 


bslbf 


Voluine_protect_flag 


1 


bslbf 


PIN 


8*4 


bslbf 


ref_thuinbiiail_index 


16 


uimsbf 


reserved_for_future_use 


256 


bslbf 


} 







FIG.18 



50 



EP1 198 133 A1 



VALUE 


CHARACTER LETTER ENCODING 


0x00 


Reserved 


0x01 


ISO/IEC 646 (ASCII) 


0x02 


ISO/IEC 10646-1 (Unicode) 


0x03-0x£f 


Reserved 



FIG.19 



51 



EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


TableOfPlayListsOl 






version.number 


8*4 


bslbf 


length 


32 


uimsbf 


nuinber_of_PIayLists 


16 


uimsbf 


for 0=0; \<number_of_PlayLists\ i++) { 






PlayList_fiIe_name 


8*10 


bslbf 


) 






) 







FIG.20 



52 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYl'ES 


ABBREVIATION 


TableOfPlaylists 0 1 






version_number 


8*4 


bslbf 


length 


32 


uimsbf 


number_of_PlayLrists 


16 


uimsbf 


for (i=0; i<number_of_PlayLists; i++) { 






PlayList_file_name 


8*10 


bslbf 


UIAppInfoPlayListO 






} 






} 







FIG.21 



53 



EP1 198 133 A1 



SYNTAX 


OF BYTES 


ABBREVIATION 








vAv^ciAn niiwnfif^i* 


8*4 


bslbf 




32 


uimsbf 








iiiuu um^ivj jKti oijv** 


32 


uimsbf 


IlliniDCr CIA Hi<tlWCE VAtVM. tCt> 


16 


uimsbf 




16 


uimsbf 


number_of_inpd„blocks 


16 


uimsbf 


1 V 


16 


bslbf 








nriiftlrf*!" 1 IB 


16 


uimsbf 


niaker_model_code 


16 


uimsbf 


start_inpd_block_number 


16 


uimsbf 


reserved 


16 


bslbf 


mpdjength 


32 


uimsbf 


} 






stufifing_bytes 


8*2*L1 


bslbf 


for(j=0; l<nurnber_of_mpdJ?locks\ j++) { 






mpd_block 


mpd_block_ 
size* 1024*8 




) 






) 






} 







FIG. 22 



54 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


xxxxx-rpls / yyyyy.vpls { 






PIayListMarkJStart_address 


32 


uimsbf 


MakersPrivateData_Start_address 


32 


uimsbf 


reserved 


192 


bslbf 


PlayListO 






for (i=0;i<Nl;i++) { 






padding_word 


16 


bslbf 


I 






PlayListMarkO 






for a=0:i<N2;i++) { 






paddmg_word 


16 


bslbf 


) 






MakersPrivateDataQ 






) 







FIG.23 



55 



EP 1 198 133 A1 




Real Playlist 



Real Playlist 



Clip 



n 



Clip 



f T 




FIG.24A 




1 1 ^^^p 




FIG.24B 



Clip 




1—JU TL 



Clip 



It. 



Clip 



Virtual Playlist : 




Virtual Playlist 




* »* 
» t * 
# # ♦ 

» • * » 


\ 
% 






;^ 




* ^ 




Real Playlist 






Real Play 
Ust 


Real Playlist 


1 Real PlayUst | 






% 

1 » 
* 1 
1 • 1 

t » i 
\ • t 
1 t 


» »■ *» i 
\ * » t t 
1 ' * t 1 
t « * ■ 1 
1 ' * * I 
I ' '11 




» * ft 

* * «i 

* * » 
» < * 

* * • 


It • • 



!_1 



Clip 



1 



FIG.24C 



56 



EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


PlayListOi 






version^number 


8*4 


bslbf 


length 


32 


uimsbf 


PIayList_type 


8 


uimsbf 


CPI type 


1 


bslbf 


reserved 


7 


bslbf 


UIAppInfoPlayListO 






number of Playltems // main path 


16 


uimsbf 


if (< Vfer/«^2/ PlayUst>) { 






number of SubPlayltems // sub path 


16 


uimsbf 


I else ( 






reserved 


16 


bslbf 


} 

1 






for (Playltem id—0: 

PlayItem_id<nymber_ofJPlayItems: 
Playltem_id+ +) { 






PlayltemO //main path 






) 






if {<yirtual PlayIJst>) { 






if (CPI_type==0 &«& PlayLjst_type=0) { 






for 0"^; i<number_of JSubPlayltems; i++) 






SubPlayltemO //sub path 






} 






1 






1 







FIG.25 



57 



EP 1 198 133 A1 



PlayUst_type 


MEANING 


0 


PLAY UST FOR AV RECORDING 

ALL CLIPS REFERENCED IN THIS PLAY LIST MUST 
CONTAIN ONE OR MORE VIDEO STREAMS 


1 


PLAY UST FOR AUDIO RECORDING 

ALL CLIPS REFERENCED IN THIS PLAYLIST MUST 
CONTAIN ONE OR MORE AUDIO S'iKEAMS AND MUST 
NOT CONTAIN VIDEO STREAMS 


2-255 


reserved 



FIG.26 



58 



EP1 198 133 A1 



CYNTAY 


NUMBER 

\jr oil iZ/iD 


ABBREVTATTON 


T IT AnnTnfnPlavT i«5t5> H f 






■ — ' — ' 


Q 
o 


UolLli 


naiii6_icngui 


Q 
O 


uimsoi 




o ^oo 


DSIDI 


reservea 


Q 

o 


DSIDI 


f^tVlA £in^ tflsit'A 


4.*14 




reserved 


8 


bslbf 


duration 


4*6 


bslbf 


valid^period 


4*8 


bslbf 


maker^id 


16 


uimsbf 


maker^code 


16 


uimsbf 


reserved 


11 


bslbf 


playback.control_flag 


1 


bslbf 


write_protect„flag 


1 


bslbf 


is_played_flag 


1 


bslbf 


archive 


2 


bslbf 


ref.thumbnail_index 


16 


uimsbf 


reserved_for_future_use 


256 


bslbf 


} 







FJG.27 



59 



EP1 198 133 A1 



write j>rotect_flag 


MEANING 


Ob 


THE PlayList CAN BE ERASED FREELY 


lb 


THE PlayList CONTENTS SHOULD NOT BE ERASED 

NORCPL\NGED EXCEPT write-protect-flag 


FIG.28A 


is_played_flag 


MEANING 


Ob 


THE PlayList HAS NOT BEEN REPRODUCED SINCE 
rrS RECORDING 


lb 


THE PlayList WAS ONCE REPRODUCED SINCE ITS 
RECORDING 


FIG.28B 


archive 


MEANING 


00b 


NO MEANING DEFINED 


01b 


ORIGINAL 


10b 


COPY 


lib 


reserved 



FIG.28C 



60 



EP1 198 133 A1 




61 




62 



EP1 198133 A1 





C/3 

O S 

PL4 





J a <u 



o 




■ i 


L 








<u 




s 












TUma 







63 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


PlayltemOl 






CUp_inforniation_CiIe_name 


8*10 


bslbf 


reserved 


24 


bslbf 


STC_jsequence_id 


8 


uimsbf 


-.. L.. .... 1 . . .1 . . . 1 . ... _-U.. 1 

IN_tiine 


32 


uitnsbf 


OUT_time 


32 


uimsbf 


reserved 


14 


bslbf 


connection_eonditioii 


2 


bslbf 


if (<Virtua! PlayList>) 1 






if (.connection_condition=^ 'J0'){ 






BridgeSequencelnfoO 






} 






} 






) 







FIG.32 



64 



EP1 198 133 A1 



CPI.type 

in the PlayListO 


1 SEMANTICS OF IN_time 


EP_map type 


IN_time MUST INDICATE UPPER 32 BITS OF 33 BIT 
LENGTH CORRESPONDING TO FIRST PRESENTATION 
UNIT IN Playltem 


TU_map type 


IN_time MUST BE TIME ON TU_map_time_axis, AND 
MUST BE ROUNDED TO time_unit PRECISION. IN-time IS 
CALCULATED BY FOLLOWING EQUATION: 

IN.time = TU_start_time 



FIG.33 



65 



EP1 198 133 A1 



-CPI_type 

in the PlayListO 


SEMANTICS OF OUT_time 


EP_map type 


OUT.time MUST INDICATE UPPER 32 BITS OF THE 
VALUE OF Presentation_end_TS CALCULATED BY 
FOLLOWING EQUTION: 

Presentation_end_TS = PTS_out+AU_duration 

WHERE PTS_out IS SS-BIT LONG PTS CORRESPONDING 
TO LAST PRESENTATION UNIT IN Playltem. AU_daration 
IS 90 kHz-DISPLAYTIME OF LAST PRESENTATION UNIT. 


TU_map type 


OUT_time MUST BE TIME ON TU_map_time_axis AND BE 
ROUNDED TO time_unit PRECISION. OUT_time IS 
CALCULATED BY FOLLOWING EQUATION: 

OUT_titne = TU_start_time %2^^ 



FIG.34 



66 



EP1 198 133 A1 



1 connection 
^condition 


MEANING 1 


00 


• CONNECTION OF PREVIOUS Playltem TO CURRENT 
Playltem IS NOT SURE AS TO SEAMLESS REPLAY. 

• IF CPI_type OF PlayUst IS TU_map type, THIS VALUE MUST 
BE SET IN connection_condition. 1 




• THIS STATE IS ALLOWED ONLY WHEN CPI_type OF 
Playlist IS EP_map type. 1 

• PREVIOUS Playltem AND CURRENT Playltem INDICATE 1 
DIVISION BECAUSE OF NON-CONTINUOUS POINT OF 
SYSTEM TIMEBASE (STC BASE) . 


10 


■ THIS STATE IS ALLOWED ONLY WHEN CPI_type OF 
Playlist IS EP_map type. 

• THIS STATE IS ALLOWED ONLY FOR Virtual Playlist 

• CONNECTION OF PREVIOUS Playltem TO CURRENT 
Playltem IS SURE AS TO SEAMLESS REPLAY. 

• PREVIOUS Playltem IS CONNECTED TO CURRENT 
Playltem USING BridgeSequence. DVR MPEG-2 TRANSPORT 
STREAM MUST OBEY DVR-STD AS LATER DESCRIBED. 


11 


• THIS STATE IS ALLOWED ONLY WHEN CPI_type OF 
Playlist IS EP_map type. | 

• CONNECTION OF PREVIOUS Playltem TO CURRENT Play 
Item IS SURE AS TO SEAMLESS REPLAY. 

• PREVIOUS Playltem IS CONNECTED TO CURRENT 
Playltem WriHGUT USING BridgeSequence. DVR MPEG-2 
TRANSPORT STREAM MUST OBEY DVR-STD AS LATER 
DESCRIBED. | 



FiG.35 



67 



EP 1 198 133 A1 



Clip 



NON- 

IN_time OUT.time rnN^rrmN IN time OUT time 

I PREVIOUS I " CURRENT T 

i ^ Plavltem ^ f •"' ""-- i^ Plavltem 

Clip 



] 



1 



IN time 



connection_cGndition=*00' 

FIG.36A 

OUT_time IN_time 



OUT time 



Clip 





PREVIOUS ! ..'-'CURRENT 
Playltem i ,y Playltem 


* 

* 

* 






• 

« 





T 



connection condition='01' 



STC NON-CONTINUOUS POINT 
(NON-CONTINUOUS POINT 
OF SYSTEM TIME BASE) 



FIG.36B 



IN_time OUT time 

I PREVIOUS ~ 

j ^ Playltem 



Clip 



IN_time OUT time 

CURRENT r 
! ^ Playltem ! 



Clip 



BridgeSequence 
Clip 



I 



SEAMLESS 
CONNECTION 

connection_condition=' 10' 



FIG.36C 



IN_time^ 5>UT,time c^^^^S^ ^'^-^^"^^CURRENT^^-""^^ 



PREVIOUS 
; Playltem 



Clip 



' Playltem j 

Clipj 



connection_condition='ll' 

FIG.36D 



68 



EP1 198 133 A1 



IN_timel OUT_timel 
i PREVIOUS 
:■ Playltem 



Clilpl 



RSPN_exit_froni 
_previous_Clip 



IN_time2 OUT_time2 
CURRE^fT i 
Playltem I 



CUlp2 



Bridge-Clip 
(Clip for 

BridgeSequence) '• 




RSPN_enter_to. 
cuiTent_Clip 



•-ADDRESS 



RSPN_arrival_time 
.discontinuity 



FIG.37 



69 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


BridgeSequencelnfoO ( 






Bridge_CIip_iaformation_file_nanie 


8*10 


bslbf 


RSPN_exit_froiii_previous_Clip 


32 


uimsbf 


RSPN_enter_to_current_CIip 


32 


uimsbf 


} 







FIG.38 



70 



EP 1 198 133 A1 



Playlist 



Playltemjd Playltemjd Playltem_id 

=0 =1 =2 
Main_Path | 1 ft^- 1 1 



Start timing of 
synchronising 



PTS = xx 



sync_PlayItem_id=l , 
sync_start_PTS_of_PlayItem=xx 



Sub_j)ath 



SubPath_IN_time 
(PTS) 



SubPath_OUT_time 
(PTS) 



Clip 

(SUPPLEMENTARY AUDIO STREAM) 



FiG.39 



71 



4 



EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYIES 


• 

ABBREVIATION 


SubPlayltemOl 






Clip_Infonnation_file_iianie 


8*10 


bslbf 


SubPath_type 


8 


bslbf 


sync_PlayItem_id 


8 


uimsbf 


sync_start_PTS_of_PlayItem 


32 


uimsbf 


SubPath_IN_time 


32 


uimsbf 


SubPath_OUT_tune 


32 


uimsbf 


} 







FIG.40 



72 



EP 1 198 133 A1 



SubPath_type 


MEANING 


0x00 


Auxiliary audio steam path 


OxOl-Oxff 


reserved 



FIG.41 



73 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


J 

ABBREVIATION 


PlayUstMarkO { 






versIon_number 


8*4 


bslbf 


length 


32 


uimsbf 1 


number_of_PIayList_inarks 


16 


uimsbf 1 


for (i=0;i<nwnber_o/_PlayList_marks;i++) { 






reserved 


8 


bslbf 1 


inark_type 


8 


bslbf . 


inark_time_stamp 


32 


uimsbf 1 


Playltem_id 


8 


uimsbf 1 


reserved 


24 


uimsbf 1 


character_set 


8 


bslbf 


naine_length 


8 


uimsbf 


inark_name 


8*256 


bslbf 


ref.thumbn ail_index 


16 


uimsbf 1 


} 






) 







FiG.42 



74 



EP1 198133 A1 



Mark_t3rpe 


MEANING 


COMMENT 


0x00 


resume-mark 


REPLAY RESUME POINT. THE NUMBER OF 
REPLAY RESURE POINTS DEFINED IN 
PlayListMarkO MUST BE 0 OR 1. 


0x01 


book-mark 


REPLAY ENTRY POINT OF PlayList THIS 
MARK CAN BE SET BY USER AND USED AS 
MARK SPECIFYING START POINT OF 
FAVORITE SCENE. 


0x02 


skip-mark 


SKIP MARK POINT. PLAYER SKIPS 
PROGRAM FROM THIS POINT TO THE END 
OF PROGRAM. THE NUMBER OF SKIP 
MARK POINTS DEFINED IN PlayUstMarkQ 
MUST BE 0 RO 1. 


0x03^8F 


reserved 




OxOOOxFF 


reserved 


Reserved for ClipMarkO 



FiG.43 



75 



EP 1 198 133 A1 



CPI_type 

in the Play List 0 


SEMANTICS OF mark_time_stamp 


EP_inap type 


mark_time_stamp MUST INDICATE UPPER 32 BITS OF 33 
BIT LENGTH PIS CORRESPONDING TO PRESENTATION 
UNIT REFERENCED BY MARK 


TU_map type 


mark_time_stamp MUST BE TIME ON TU_map_time_axis 
AND MUST BE ROUNDED TO time.unit PRECISION. 
mark_time_stamp IS CALCULATED BY FOLLOWING 
EQUATION: 

mark_time_stamp = TU_start_time %2 



FIG.44 



76 



EP1 198 133 A1 



SYNTAX 



2zzzz.clpi { 



NUMBER 

OF BYTES lABBREVIATlON 



STC_Info_Start_address 



32 



uimsbf 



I*rogramInfo_Start_address 



32 



uimsbf 



CPI_Start_address 



32 



uimsbf 



CiipMark_Start_address 



32 



uimsbf 



MakersPrivateData_Start_address 



32 



reserved 



96 



uimsbf 



bslbf 



CUpInfoO 



for 0=0;i<Nl;i++){ 



padding_word 



16 



bslbf 



) 



STCJnfoO 



for (i=0;i<N2;i++) ( 



padding_word 



16 



bslbf 



ProgramlnfoQ 



for (i=0;i<N3:i++) I 



padding_vt'ord 



16 



bslbf 



} 



CPIO 



for (i=0;i<N4;i++) { 



padding_word 



16 



bslbf 



} 



ClipMarkO 



for (i=0;i<N5;i++) { 



padding_word 



16 



bslbf 



) 



MakersPrivateDataO 



FIG.45 



77 



EP1 198133 A1 



1 

SYNTAX 


NUMBER 
OF BYTES 


j 

ABBREVIATION 


ClipInfoOl 




1 


1 version^number 


8*4 


bslbf 


1 length 


32 


uimsbf 1 


1 Clip_stream_type 


8 


bslbf 


offset.SPN 


32 


uimsbf 1 


j TS_recording_rate 


24 


uimsbf 1 


j reserved 


8 


bslbf 


j record_time_and^datc 


4*14 


bslbf 


{ reserved 


8 


bslbf 1 


1 duration 


4*6 


bslbf 


J reserved 


7 


bslbf 


1 time_controlIed^flag 


1 


bslbf 


TS^average^rate 


24 


uimsbf j 


j V( Clip_streamjtype^—l) // Bridge-Clip AV stream 




1 


J RSPN_arrival_tinie_discontinuity 


32 


uimsbf 1 


j else 




1 


j reserved 


32 


bslbf 1 


J reserved_for_system_use 


144 


bslbf 


j reserved 


11 


bslbf 


1 is_format_identifier_valid 


1 


bslbf 1 


j is_original_n«twork_ID_valid 


1 


bslbf 


1 is_transport_streani_H>_valid 


1 


bslbf 1 


I is_service_ID_valld 


1 


bslbf 


j is_country^code„YaIid 


1 


bslbf 1 


j format_identifier 


32 


bslbf 


origmaLnetvrork_lD 


16 


uimsbf 1 


1 transport_streain_ID 


16 


uimsbf 1 


j service_ID 


16 


uimsbf 1 


j country_code 


24 


bslbf 


1 stream_forinat_name 


16*8 


bslbf 


reserved for_fortune use 


256 


bslbf 


I' 







FIG.46 



78 



EP 1 198 133 A1 



Clip_stream_type 


MEANING 


0 


Clip AV STREAM 


1 


Bridge-Clip AV STEiEAM 


2-255 


Reserved 



RG.47 



79 



EP1 198 133 A1 



original 
Clip 

AV stream 



FIRST SOURCE PACKET 
OF Clip AV STREAM 



i 


1 




i 






• • > 







offset SPN=0 



ADDRESS OF Clip AV STREAM 
(RELATIVE SOURCE 
PACKET NUMBER) 




ERASURE OF SOURCE 
PACKETS SHOWN SHADED 



edited 
Clip 

AV stream 



offset.SPN=4 



ADDRESS OF Clip AV STREAM 
(RELATIVE SOURCE 
PACKET NUMBER) 



FIG.48 



80 



EP 1 198 133 A1 



Clip 

AV stream 



, FIRST SOURCE PACKET 
^ OF Clip AV STREAM 



offset_SPN RSPN_xxx 



ADDRESS OF Clip AV STREAM 
(RELATIVE SOURCE 
PACKET NUMBER) 



SPN xxx<=5 



TIME DOMAIN NOT 
CONTAINING STC 
NON-CONTINUOUS 
POINT 



FIG.49 




FIG.50A 



o .'ARRIVAL TIME OF 
LAST BYTE OF PCR IN 
TS PACKET 



ARRIVALTIME CLOCK 



STC=Ox IJ 



STC 
1 



lllllll 



TIME DOMAIN NOT 
CONTAINING STC 
NON-CONTINUOUS 
POINT 



STC=0 



STC33 BIT COUNTER IS 
WRAPAROUNDED HERE 




ARRIVALTIME CLOCK 



FiG.SOB 



81 



EP1 198 133 A1 




82 



« 



EP1 198 133 A1 



SYNTAX 



NUMBER 
OF BYTES I ABBREVIATION 



STC_InfoO{ 



version_niimber 
length 



8*4 



32 



if (length !=0){ 



reserved 



8 



num_of_STC_sequeiices 



for {STC_sequenceJd=0: 

STC_sequence_id<num_pf_STC_^equences; 
STC_sequence_id++) { 



8 



bslbf 



uimsbf 



bslbf 



uimsbf 



} 



} 



resereved 



32 



} 



RSPN_STC_start 



32 



bslbf 



uimsbf 



FIG.52 



83 



EP1 198 133 A1 







84 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OFBYTCS 


ABBREVIATION 


ProcramlnfoD 1 








8*4 


bslbf 




32 


uirnoKf 










g 


bslbf 


number of Dro^ram seauences 


8 


uimsbf 

txxixx^xyx 










32 


iXIl i iZ> LyX 




48 


bslbf 


ppo Pin 


Ifi 


h^ilhf 1 


niifwilii^T* vif1pA<6 




iiim^bf 

iXXXXXOX^X 


nuinber_of_audios 


8 


uimsbf 


for (k=0;k</i«m^er_c{/LviVfec?^;k++) { 






video_streain_Pn> 


16 


bslbf 


VideoCodinglnfoQ 






} 






for (k=Oik<number_o/_audiosik-t-t-) { 






audio _3treain_PID 


16 


bslbf 


AudioCodinglnfoQ 






1 






} 






1 






1 







FIG.54 



85 



EP1 198 133 A1 

m 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


VideoCodinglnfoO ( 






yideo_format 


8 


uimsbf 


&*ame_rate 


8 


uimsbf 


display_aspec:t_ratio 


8 


uimsbf 


reserved 


8 


bslbf 


I 







FIG.55 



86 



EP 1 198 133 A1 

* 



video_format 


MEANING 


0 


480i 


1 


576i 


2 


480p (including 640x480p format) 


3 


1080i 


4 


720p 


5 


lOSOp 


6-254 


reserved 


255 


No information 



FIG.56 



frame_rate 


MEANING 


0 


forbidden 


1 


24 000/1001 (23.976...) 


2 


24 


3 


25 


4 


30 000/1001 (29.97..) 


5 


30 


6 


50 


7 


60 000/1001 (59.94..) 


8 


60 


9-254 


reserved 


255 


No information 



FIG.57 



87 



EP 1 198 133 A1 



display_aspect_ratio 


MEANING 


0 


forbidden 


1 


reserved 


2 


4:3 display aspect ratio 


3 


16:9 display aspect ration 


4-254 


reserved 


255 


No information 



FIG.58 



88 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


AudioCodinglnfoO f 






audio_format 


8 


uimsbf 


audio_component_type 


8 


uimsbf 


sainpling_frequency 


8 


uimsbf 


reserved 


8 


bslbf 


1 







FIG.59 



89 



EP 1 .1d8 133A1 



audio_coding 


MEANING 


0 


MPEG-1 audio layer I or II 


1 


Dolby AC-3 audio 


2 


MPEG-2 AAC 


3 


MPEG-2 multi-channel audio, backward 




compatible to MPEG-1 


4 


SESF LPCM audio 


5-254 


reserved 


255 


No information 



FIG.60 



90 



EP 1 198 133 A1 



audio_compo nent_type 


MEANING 


0 


single mono channel 


1 


dual mono channel 


2 


stereo- (2-channel) 


3 


multi-lingual> multi-channel 


4 


surround sound 


5 


audio description for the visually impaired 


6 


audio for the hard of hearing 


7-254 


reserved 


255 


No information 


FIG.61 


sampling frequency 


MEANING 


0 


48 kHz 


1 


44.1kHz 


2 


32 kHz 


3-254 


reserved 


255 


No information 



FIG.62 



91 



EP 1 198 133 A1 




92 



EP 1 198 133 A1 




93 



EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


CPIOf 






version.number 


8*4 


bslbf 


length 


32 


uimsbf 


reserved 


15 


bslbf 


CPI_type 


1 


bslbf 


if (CPI_type==0) 






EP_mapO 






else 






TU_mapO 






) 







FIG.65 



94 



EP1 198 133 A1 



CPI_type 


MEANING 


0 


EP map type 


1 


TU map type 



FIG.66 



Clip 

AV STREAM 



pts(xl) 

pts(yl) 




( pts(zl) 



pts(y2) ptsCyn) 
( pts(x2) ( pts(zm) 

pts(z2) I J pte(xk) 




Z2 




RELATIVE 
SOURCE 
PACKET 

NUMBER 



• SOURCE PACKET CONTAINING FIRST BYTE OF SEQUENCE 

■ HEADER video_PID=x 

. SOURCE PACKET CONTAINING HRST BYTE OF SEQUENCE 

■ HEADER video_PID=y 

. SOURCE PACKET CONTAINING FIRST BYTE OF SEQUENCE 

■ HEADER video PID=z 



EF_map 

number_of_stream/PIDs=3 



EP_map_for_ 
one_stream_PID (0) 

stream_PID(0)=x N 
nura_EP_entries (0) =k 



PTS_EP 


RSPN.EP 


start 


start 


pts(xl) 


XI 


pts(x2) 


X2 


m m w 

pts(xk) 


« • • 



EP_map_for_ 
one_stream_PID (1) 

streanx_PID(l)=y ^ 
num_EP_entries (1) =n 



PTS_EP 


RSPN_EP 


start 


start 


pts(yl) 


Yl 


pts(y2) 


Y2 


• • • 

pts(yn) 


• • « 

Yn 



EP__map_for_ 
one„stream_PID (2) 

stream_PID(2)=z ^ 
num_EP_entries (2)=m 



PTS_EP 


RSPN.EP 


start 


start 


pts(zl) 


Zl 


pts(z2) 


Z2 


• • « 

pts(zm) 


• « • 

Zm 



FIG.67 



95 



EP 1 198 133 A1 



Clip 

AV STREAM 



SOURCE PACKET 
REFERENCING 
the STC_sequence #1 



SOURCE PACKET 
REFERENCING 
the STC_sequence #2 



XI 1 Xln 




X21 X2m 



RSPN_STC_star«fl RSPN_STC_start#2 



^RELATIVE 
SOURCE 
PACKET 
NUMBER 



. SOURCE PACKET CONTAINING FIRST BYTE OF SEQUENCE 
1 • HEADER video_PID=x 

. SOURCE PACKET REFERENCED BY RSPN_STC_start 
^ • (DEFINED IN the STCJnto) 

EP_map_for_one_sterani_ PID 
video_PID=x 



PTS_EP 


RSPN_EP 


start 


start 


pts(xll) 


XI 1 


pts(xln) 


• * « 

Xln 


pts(x21) 


X21 


■ • • 

pts(x2m) 


3c2m 



) 



DATA BELONGING TO 
STC_sequence #1 

boundary 



RSPN STC start #2<X21 



DATA BELONGING TO 
j STC_sequence #2 

FIG.68 



Clip 

AV STREAM 



video_PID=x video_PID=y video_PID=x 



program #1 


program #2 


program #3 





EP_map 

number_of_stream_PIDs=3 



RELATIVE 
^ SOURCE 
PACKET 
NUMBER 



EP_map_for_ 
one_stream_PID (0) 

stream_PID(0)=x 



EP_map_for_ 
one_streara_PID (1) 

stream_PID(l)=y 



EP_map_for_ 
one_stream_PID (2) 



stream_PID(2)=x 



FIG.69 



96 



EP 1 198 133 A1 



bYNTAX 


NUMBER 

Ur or Ito 


ADJBKbVIAllON 


EP_mapOi 






reserved 


12 


bslbf 


EP_type 


4 


uimsbf 


number_of_streamJPIDs 


16 


uimsbi 


for (k=0;k<rtiwwer_<jt_jO'e<2m_P/Dj;k++) i 






stream JPIDfife) 


16 


OSlDl 


num_EP_entr icsf k ) 


32 


uimsbf 


EP_inap_for_one_stream_PID_Start_addressCA:> 


32 


uimsbf 


} 






for (i=0;i<X;i++) { 






padding_word 


16 


bslbf 


} 






for (^=0;k<number_o/jstream_PIDsik++) { 






EP_map_for_one_stream_PID(num_£F_enfriesCifcj) 






for (i=0;i<Y,i++) { 






padding_word 


16 


bslbf 


} 






} 






} 





FIG.70 



97 



EP1 198 133 A1 



EP_type 


MEANING 


0 


video 


1 


audio 


2-15 


reserved 



FIG.71 



98 



EP1 198 133 A1 



SYNTAX 


NUMBER 

OF BYTES 


■ 

ABBREVIATION 


EP_map_for_one_stream_PID (AO { 






for Q'^0;\<N;\++) { 






PTS_EP_start 


32 


uimsbf 


RSPN_EP_start 


32 


uimsbf 


) 






) 







FIG.72 



99 



EP1 198 133 A1 




100 



EP 1 198 133 A1 



SYNTAX 


NUMBER 




OF BYTES 


ABBREVIATION 


TU_mapO { 






offset.tiine 


32 


bslbf 


time__unit_size 


32 


uimsbf 


number_of_time_unit_entries 


32 


uimsbf 


for O<=0\k<number_o/_time_unit_entries',k.++) 






RSPN_time_unit_start 


32 


uimsbf 


} 







FIG.74 



101 



EP 1 198133 A1> 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


ClipMarkO { 






version^number 


8*4 


bslbf 


length 


32 


uimsbf 


number_of_Clip_marks 


16 


uimsbf 


for (i=0; i<nuniber_pfjclip_marks; i++) { 






reserved 


8 


bslbf 


mark_type 


8 


bslbf 


niark_tirae_stamp 


32 


uimsbf 


STC_sequcnce_id 


8 


uimsbf 


reserved 


24 


bslbf 


character^set 


8 


bslbf 


name.Iength 


8 


uimsbf 


mark^name 


8*256 


bslbf 


ref.thunibnai]_index 


16 


uimsbf 


) 






I 







FtG.75 



102 



EP1 198 133 A1 



Mark_fype 


MEANING 


COMMENT 


0x00-Qx8F 


reserved 


Reserved for PlayListMarkO 


0x90 


Event-start mark 


MARK POINT INDICATING PROGRAM START POINT 


0x91 


Local event-start mark 


MARK POINT INDICATING LOCAL SCENE IN PROGRAM 


0x92 


Scene-start mark 


MARK POINT SHOWING SCENE CHANGE POINT 


0x93-0xFF 


reserved 





FIG.76 



103 



EP 1 198 133 A1 



CPI_type 

in the PlayUstO 


SEMANTICS OF marletime_stamp 


EP_niap type 


mark_time_stainp MUST INDICATE UPPER 32 BITS OF 33 
BIT LENGTH PTS CORRESPONDING TO PRESENTATION 
UNIT REFERENCED BY MARK 


TU_map type 


mark_time_stamp MUST BE TIME ON TU_raap_time_axis 
AND MUST BE ROUNDED TO time_unit PRECISION. 
mark_time_stamp IS CALCULATED BY FOLLOWING 
EQUATION: 

mark_time_stamp = TU_start_time %2^^ 



FIG.77 



104 



EP 1 198 133 A1 

.1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


menu.thmb/mark-thmb { 






reserved 


256 


bslbf 


ThumbnailO 






for (i*0; i<Nl; i++) 






padding_word 


16 


bslbf 


} 







FIG.78 



105 



EP1 198133 A1 



SYNTAX 



NUMBER 
OFBYTES 



ABBREVIATION 



Thumbnail 01 



version number 



8*4 



char 



length 



32 



uimsbf 



if Oength !=0) { 



tn blocks start address 



32 



bslbf 



number of thumbnails 



16 



uimsbf 



tn_block_size 



16 



number_of_tn_bIocks 



16 



uimsbf 



uimsbf 



reserved 



16 



bslbf 



for 0=0; i<number_ofjthumbnails; i+-f) ( 



thumbn ail.index 


16 


uimsbf 


thumbnail_picture_format 


8 


bslbf 


reserved 


8 


bslbf 


picture_data_size 


32 


I uimsbf 1 


start_tn_block_number 


1 ^® 


uimsbf 1 


x_picturejength 


16 


uimsbf 


y_picture„length 


16 


uimsbf 1 


reserved 


16 


uimsbf 1 


} 






stuffing_bytes 


8*2*L1 


bslbf 


forOc=0; k<number_pf_tnjb locks; k++) { 






tn_block 


tn__bIock_ 
size* 1024*8 





FIG.79 



106 



EP1 198 133 A1 



Thumbnail_picture_format 


MEANING 


0x00 


MPEG-2 Video 1-picture 


0x01 


DCF (restricted JPEG) 


0x02 


PNG 


0x03-0xff 


reserved 



FiG.80 



PICTURE DATA 



Thumbnail 0 



FIG.81A 



FIG.81 B 




stuffing 




stu£fing_bytes 



tn_blockO 



tn_blockO 



Thumbnail 0 




107 



EP 1 198 133 A1 



DVR MPEG-2 TRANSPORT STREAM 



Aligned 
unit 


Aligned 
vaait 


Aligned 
unit 




Aligned 
unit 


Aligned 
. unit 


6144 
BYTES ^ 


^ *• _ 

* • 


^ * ^ 

* ^ ^ 
















SOURCE 
PACKET- 0 


SOURCE 
PACKET- 1 


SOURCE 
PACKET- 2 




SOURCE 
PACKET- 31 




192 
^ BYTES ^ 


* 









TP_extra 
header 


TRANSPORT 
PACKET 


4 

BY I KS ^ 


188 
BYTES 



FIG.82 



108 



EP1 198 133 A1 




109 



EP 1 198 133 A1 




EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIAHON 


source_packetO I 






TP_extra_header() 






transport packetO 













FIG.85 



111 



-4 

EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


TP_extra_headerO { 






copy_pennission_indicator 


2 


uimsbf 


arrival_tune_stamp 


30 


uimsbf 


) 







FIG.86 



112 



EP1 198^133 A1 



copyjpermission 
Jndicator 


MEANING 


00 


copy free 


01 


no more copy 


10 


copy once 


11 


copy prohibited 



FIG.87 



113 



EP1 198133 A1 




I 



O cn 
^ B 



mm 



I 



mm 




CO 

I o 



C/7 CJ 




00 
00 

d 

LL. 



114 



EP1 198 133 A1 




115 




116 



EP 1 198 133 A1 





117 



EP1 198133 A1 




118 



EP1 198133 A1 




EP1 198 133 A1 




120 



EP1 198 133 A1 




121 



EP1 198133 A1 



III 



27MHz 
X-tal 



27MHz 
FREQUENCY 



ARRIVAL 

TIME 
CLOCK 
COUNTER 

1 



arrval_time_clock G) 



jr73 



74x 



INITIAL 
VALUE 



rZS 



DVR 
DRIVE 


Km ax 


SMOOTHING 
BUFFER 




SOURCE 
DEPACKEnZER 


SOURCE*" 
PACKET 





Rpk 



(DVR MPEG2 
TS) 



TRANSPORT 

PACKET 
(MPEG2 TS) 



78 



7 7\ Rxl \ Rbxl /7 9 





TBI 




MBl 




EBl 














Pl(k) 




1 


... 

TBn 


Rxn 


/ 

Bn 












oPn(k) 



TBsys 


Rxsys 


Bsys 






85 

SYSTTEM 
CONTROL 



FIG.96 



122 



EP 1 198 133 A1 



SOURCE 
PAKETOF 
TSl 




ATCl 



TSl. 

VIDEO 
PRESENTATION 
UNrrOFTSl, 




SOURCE 
PAKETOF 
TS2 



ATC2 



VIDEO 
PTSs 

AUDIO 

PTSs 




■ 

■ 

I 
I 
t 
■ 
t 
* 
t 
t 
• 
• 
t 
t 



□□□□□□□□□□□ 



VIDEO 
PRESENTATION 
UNIT OF TS2 




AUDIO 
PRESENTATION 
UNIT OF TSl 



STcT* 
OVERLAP 



Tl 



T2 



AUDIO 
PRESENTATION 
UNIT0FTS2 



STCl 



PTS^end +Tpp 



PTS2 



■^STC2 



start 



LAST VIDEO PACKET OF 
TSl INPUT TO DVRSTD 



T4 



AUDIO 
OVERLAP 



*-TIME 



T3 T5 



FIG.97 



123 



EP -1 Ids 133 A1 



SYNTAX 



NUMBER 
OF BYTES 



ABBREVIATION 



xxxxx.rpls / yyyyy.vpls { 



version_nuraber 



8*4 



bslbf 



PIayList_start_address 



PlayListMark_start_address 



32 



32 



uimsbf 



ulmsbf 



MakersPrivateData_start_address 



32 



ulmsbf 



reserved_for_future_use 



160 



bslbf 



UIAppInfoPlayListQ 



for (i=0;i<Nl;i++) { 



padding_word 



16 



bslbf 



I 



PlayListO 



for (i=0;i<N2;i++){ 



padding_word 



16 



bslbf 



} 



PlayListMarkQ 



for (i=0;i<N3;i++){ 



padding_word 



16 



bslbf 



MakersPrivateDataO 



for (i=0;i<N4;i++) I 



padding_word 



16 



bslbf 



FIG.98 



124 



EP1 198 133 A1 



1 CVNTTTAV 


I NUMBER 
OF BYTES 


JABBREVIAuON 1 


UlApplnioFiayJustU i 




J 1 


1 length 


32 


uimsbf 1 


1 PlayList_service_type 




J 


1 PIayList_character_set 


8 


uimsbf 1 


1 reservea_ior_wora_aiign 


3 


bslbf 1 


j playback_control_flag 


1 


uimsbf 1 


1 write_protect_flag 


1 


uimsbf 1 


is_playcd_flag 


1 


uimsbf 1 


1 archive 


2 


uimsbf 1 


record_time_ana_date 


1 4*14 


bslbf 1 


duration 


4*6 


bslbf 1 


j maker^ID 




uimsbf 1 


niaker_inodel_code 


16 


uimsbf i 


1 rei_thuinbnail_index 


16 


uimsbf 1 


j reserved | 


7 


bslbf 1 


1 rp_into_vaiia_iiag | 


1 


uimsbf 1 


1 rp_ref_to_PlayItein_id | 


16 


uimsbf j 




1 


UllUoUi 1 


1 chaimel^number | 


16 


uimsbf 1 


j reserved_for_word_align 1 


8 1 


bslbf 


1 channel_iiame_length j 


8 


uimsbf 1 


1 channel.name | 


8*20 


bslbf 


1 PlayList^name.length 1 


8 


uimsbf 1 


1 Play Lis t^name | 


-8*255 


bslbf 


PlayList_detaiMength | 


16 


uimsbf 1 


PlayList^detail | 


8*1200 


bslbf 


} 1 







FIG.99 



125 



EP1 198133 A1 



SYNTAX 


NUMBER 
OF BYTES 


.ABBREVIATION 


PlayListO { 

^^^^^ ^^^^^^^ ^fc^P ^ 






length 


32 


uimsbf 


reserved_for_word_align 


15 


bslbf 


CPI.type 


1 


bslbf 


number_of_Play Items 


16 


uimsbf 


if (<Vertual PlayUst> && CPLtype=-0) { 






number of SubPlayltems 


16 


uimsbf 


}else{ 






reserved_for_word_align 


16 


bslbf 


} 






for (JPlayltem^id^O: 

PlayIt€m_id<nymber_of_J*layItems; 
Playltemjid+ +) { 






PlayltemO 












if (<Virtual PlayList>&& CPLtype==0) { 






for (i=0; \<number_of JSubPlay Items; i+-f) 






SubPIayltemO 






— — -■ ' ■" 

} 












} 







FIG.100 



126 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


SubPlayItemO{ 






length 


16 


uimsbf 


Clip_Infonnation_file_name 


8*10 


bslbf 


SubPath_type 


8 


bslbf 


STC _;sequence_id 


8 


uimsbf 


SubPath_IN_time 


32 


uimsbf 


SubPath_OUT_time 


32 


uimsbf 


sync_PlayItem_id 


16 


uimsbf 


sync_start_PTS_of_PlayItem 


32 


uimsbf 


1 







FIG.101 



127 



EP1 198 133 A1 



C 



START FORMULATING 
Real PlayList 



RECORD Clip AV STREAM 

i 

< ^CAN EP_map BE FORMULATED ?] > 



Sir 



S12 

NO 





YES 


— 313 




FORMULATE EP_map 





t 



S14 



FORMULATE TU_map 



T 



SET PlayList CPI_type 



i 



FORM PlayUstO CONSISTING OF Playltem 
COVERING ALL REPRODUCIBLE RANGES 

OF ABOVE CUp. IF CPI_type IS EP_map 
TYPE, SET TIME INFORMATION BY PTS 
BASE. IF CPLtype IS TU_map TYPE, SET 
TIME INFORMATION ON ARRIVAL TIME 

BASIS. 



I 



S16 



FORMULATE UIAppInfoPlayUstQ Si 7 

FORMULATE PlayDstMark 0 h-^ S 1 8 




S19 



RECORD Real PlayUst FILE 

"~T" 



c 



END 



3 



FIG.102 



128 



EP 1 198 133 A1 



C 



START FORMULATING 
Virtual HayList 



USER SPECIFIES ONE Real PlayList FROM 
REPRODUCTION DOMAIN OF Real PlayUst, USER 
SELECTS REPRODUCTION DOMAIN AT IN AND 
OUT POINTS. IF CPLtype IS EP_map TYPE, SET 
TIME INFORMATION ON PTS BASIS AND, IF 
CPI_type IS TU_map TYPE, SET TIME INFORMATION 

ON ARRIVAL TIME BASIS. 




I 



S31 



REPRODUCTION DOMAIN SPECIFYING 
OPERATION BY USER END ? 



|YES 




S32 



USER OR RECORDING DEVICE SETS 
connection_condition BETWEEN TWO 
CONSECUTIVELY REPRODUCED 
REPRODUCTION DOMAIN 



I 



S33 



IF CPLtype IS EP_map TYPE, USER SPECIFIES 
SUB-PATH INFORMATION (AUDIO FOR AFTER 

-RECORDING) (OPTION) 



I 



S34 



FORMULATE PlayList 0 BASED ON USER 
SPECIFIED REPRODUCTION DOMAIN 
INFORMATION AND connection_condition 



I 



S35 



FORMULATE UIAppInfoPIayUstO 



f 



S36 



FORMULATE PlayUstMarkQ 

t 



FORMULATE MakersPrivateDataQ 



I 



}-^S38 



RECORD Virtual PlayUst FILE 



c 



~\ — 339 



END 



FIG.103 



129 



EP1 198 133 A1 



c 



START 



PLAYER ACQUIRES INFORMATION OF 
Info.dvr, Clip Information file. Play List file AND 
THUMBNAIL FILE TO FORMULATE GUI PICTURE 



S51 



J 



PRESENT ON GUI PICTURE INFORMATION 
EXPLAINING PlayUst BASED ON 
UIAppInfoPlayUstO OF EACH PlayList 



I 



USER SPECIFIES REPLAY OF ONE PlayUst S53 



IF CPI_type IS EP_map TYPE, ACQUIRE SOURCE PACKET 
NUMBER WHERE THERE IS ENTRY POINT 
TEMPORALLY BEFORE AND CLOSET TO IN_time. 
IF CPI_type ISTU_map TYPE, ACQUIRE SOURCE 
PACKET NUMBER WHERE BEGINS TIME UNIT 
TEMPORALLY BEFORE AND CLOSEST TO IN_time 
FROM IN_time OF CURRENT Playltem. 



S54 



READ OUT DATA OF AV STREAM FROM SOURCE 
PACKET NUMBER OBTAINED AT ABOVE STEP 
TO SUPPLY IT TO DECODER 



I 



S56 



PERFORM CONNECTION PROCESSING OF 
DISPLAYWITH TEMPORALLY PREVIOUS Playltem 
IN ACCORD A NCE WI TH connection_condition 



S56 



IF CPI_type IS EP_map TYPE, DECODER STARTS 
DISPLAY FROM IN_time PTS PICTURE. IF 
CPI_type ISTU_map TYPE, DECODER STARTS 
DISPLAY FROM PICTURE SUBSEQUENT TO 

IN time 



i 



S57 



CONTINUE DECODING AV STREAM 

i- — 




OUT_time ? 

Tyes 



-\NO 



1 



DISPLAY 
PICTURE 



S60 



LAST Playltem ? ^ 



NO 



c 



iYES 



END 



FIG.104 



130 



T 



EP 1 198 133 A1 




c 



START SUB-PATH REPLAY J 

r — 



ACQUIRE SubPlayltem INFORMATION 



i 



S71 



ACQUIRE SOURCE PACKET NUMBER WHERE 

THERE IS ENTRY POINT TEMPORALLY 
BEFORE AND CLOSEST TO SubPath IN time 



i 



S72 



READOUT DATA OF AV STREAM OF SUB-PATH 
FROM SOURCE PACKET NUMBER WHERE 
THERE IS ABOVE ENTRY POINT TO SUPPLY 

IT TO DECODER 



I 



S73 



WHEN Main PATH REPLAY IS PICTURE SHOWN 

BY sync_PlayItem_id AND 
sync_start_PTS_of_PlayItein 
START SUBPATH DISPLAYING 



S74 



CONTINUE DECODING 
SUB-PATH AV STTREAM 



S76 



I 



< ^^ubPath_QUT_time ? ^ 
Q END ^ 



i 



DISPLAY 
SUB-PATH 



FIG.105 



131 



EP1 198 133 A1 



C 



START FORMULATING 
PlaylistMark 



I 



PLAYER ACQUIRES INFORMATION OF 
Info.dvr, Clip Information file, PlayList file 
AND Thumbnail file TO FORM GUI PICTURE 



I 



S91 



USER COMMANDS REPLAY OF ONE PlayList 



1 



START REPLAY OF COMMANDED PlayUst REPLAY 



I 



S93 



USER COMMANDS MARK SET AT FAVORITE 

SCENE 



I 



S94 



IF CPLtype IS EP_map, ACQUIRE MARK PTS 
AND Playltem.id OF Playltem IT BELONGS. 
IF CPI.type ISTU_map, ACQUIRE MARK 
POINT ARRIVAL TIME. 



I 



STORE MARK INFORMATION 
IN PlayListMarkO 



S96 



RECORD PlayList FILE 



S97 



c 



END 



FIG.106 



132 



EP1 198 133 A1 



START LOCATING REPLAY 

USING PlaylistMark 
I - 



USER ACQUIRES INFORMATION OF 
Info.dvr, Clip Information file, PlayUst file AND 
Thumbnail file TO PREPARE GUI PICTURE 



I 



USER COMMANDS-REPLAY OF ONE PlayUst 



DISPLAY ON GUI UST OF THUMBNAIL 
GENERATED FROM PICTURE 
REFERENCED IN PlayUstMark 



I 



USER SPECIFIES MARK POINT OF REPLAY 

START POINT 



IF CPI_type IS EP_mapTYPE, ACQUIRE MARK 
PTS AND Playltem_id IT BELONGS. IF CPI.type IS 
TU.map TYPE, ACQUIRE MARK ATS 
(Arrival Time Stamp) 

I 



IF CPI_type IS EP_mapTYPE, ACQUIRE 
STC-sequence-id OFAVSTERAM REFERENCED 
BY Playltem SPECIFIED BY Playltemjd 



I 



IF CPLtype IS EP_mapTVTE, INPUT TO 
DECODER AV STREAM BASED ON ABOVE 
STC-sequence-id AND MARK PTS. IF CPI_type 
IS TU_mapTYPE, INPUT TO DECODER AV 
STREAM BASED ON MARK ATS 



I 



IF CPLtype IS EP_mapTYPE. START DISPLAY 
FROM PICTURE OF MARK POINT PTS. IF 
CPLtype IS TU.mapTYPE, START DISPLAY FROM 
PICTURE SUBSEQUENT TO MARK POINT ATS. 



Q END ^ 

FIG.107 



133 



EP1 198 133 A1 




134 



-EP 1 198 133 A1 



INTERNATIONAL SEARCH REPORT 


latBrnsticaBl application No. 




PCT/JPOl/03417 



A. CLASSDFICATION OF SUBJECT MATTER 

Int. CI'' H04N 5/93, GllB 20/l0 



According to Intenational Patent Ciasaificatioa (IPC) or to both national classification and IPC 

B. FIELDS SEARCHED 

Mimmum documentation searched (classification systm fbllowed by classtfkatim symbob) 

Int. CI'' H04N 5/76-5/956, 7/24-7/68, GllB 20/L0-20/12 



noqrmfflttatfcm searched other than ciintmam docu^^ fields searched 

ijitsuyo Shinan Koho 1922-1996 ToroJcu Jitsuyo Shinan Koha 1994-2001 

Kbkai Jitsuyo S3iinan Koho 1971-2001 Jitsuyo Shinan Toroku Koho 1996-2001 

Electronic data base cansnltcd during^ thc mtcniatioiuil seaich (name of data base aod, wbcrc practicable, search tenns usod) 



a DOC:L7t{SNTS(X)KSIDERBD TO BB RELEVANT 



Category* 



Citation of document, with indtcation, where appropriate, of fhc relevant passages 



Reicvant to claim No. 



JP, 2001-157145, A (Sony Corporation), 

08 June, 2001 (08.06.01}, 

Pull text; Figs. 1 to 29 (Paniily: none) 

JP, 11-243517, A (Sony Corporation), 

07 September, 1999 (07.09.99), 

Full text:; Figs. 1 to 4 { Family: none) 



1-14 



1-14 



n Fiuther docamentsai^ listed in the ccntimiattan of Box C. 

* Special eidegories of cited documeab: 

"A** document defining (he general state of the art which is not 

coDSidnetf to be of paiticiiJar relevance 
"E* earlier yfaotnimt but pubEsixd od or afbcr the tnteinationB] fifing 

date 

'i/ document which may -Ommr doubts oo pnority clein:(8> or wkkh is 
cited to establish (he publication date of another citsdoa oi o&er 
special reason (oa specified) 

"or doc um e n t lefenhie to an «al digdOTOP, use, eadribiticn ercflter 
mesns 

'T* dococnent publisdkcd prior to the inteniaikna] filmg date but later 
than the priority date claimed 

Date of tiie actual conviction of the intemational seatcb 
12 June, 2001 (12.06.01) 



Name and mailing address of fbe ISA/ 
Japanese Pat.enC Office 

FacsiinileNo. 
Fann PCmSA/210 (second sheet) (July 1992) 



I I See patent family annex. 

*T' lato docnmect published aftcf the fateraational filing date or 
priority date and mt in ooafljct with the appEcatioii but cited to 
undec^bnd the prinetpte or theory underlying the invention 
docmnent of pardcuUr relevance: tbe claimed hivectian comet be 
considered novel or cannct be coasidered to involve an inveitive 
step when the documeii} is teten aloac 

"V docamem of partieular retsvance; the clainted invention cannot be 
eansidexod to invobne an iavci:live step when the document is 
combined tvith one or more otiiersoch documoitBi cucb 
OQitibfaiation bemg ohvions tn apeoon sMUod m the ait 
document member of the same patent ftodly 

Dats of mailing of the intemational seamh report 
19 Jiine, 2001 (19.06.01) 



Autborized ofiBcer 



Telephone No. 



135 



